# Robots.txt file from http://www.myspacegraphicshelper.com # All robots will spider the domain User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /_private/ Disallow: /scripts/ Disallow: /submit/ Disallow: /php/ Disallow: /msghgen/ Disallow: /Report/ Disallow: /stats/ Allow: /1000/*/ Allow: /2000/ User-agent: Googlebot Disallow: /cgi-bin/ Disallow: /images/ Disallow: /_private/ Disallow: /scripts/ Disallow: /submit/ Disallow: /msghgen/ Disallow: /Report/ Disallow: /stats/ Allow: /1000/ Allow: /2000/ Allow: /1000/*/ User-Agent: W3C-checklink Allow: /*/