# robots.txt helps restrict search engine access to directories User-agent: * Disallow: /dev/ Disallow: /js/ Disallow: /css/ Disallow: /errors/ Disallow: /admin/ Disallow: /reports/ Disallow: /Anonymous/ Disallow: /config/