# This is a robots.txt file that can be used to indicate to # WWW robots which parts of a web site should not be indexed # and where the sitemaps are located. User-agent: * Disallow: /cgi-bin/ Disallow: /css/ Disallow: /js/ Disallow: /images/ Sitemap: Sitemap: Sitemap: