# Don't crawl through these directories User-agent: * Disallow: /admin/ Disallow: /data/media/ Disallow: /details.php Disallow: /RogueBotTrap/ User-Agent: Googlebot-Image Disallow: /data/media # Error 404 "Document Not Found" occurred for: # http://vividviews.com/TEMplAtES/cHRis/sTyle.csS User-agent: baiduspider Disallow: / # Produces Guardian notices for http://vividviews.com/+cartURL+ # http://yuntis.ecsl.cs.sunysb.edu/ or http://www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot User-agent: Gulper Disallow: /