---- robots.txt (contents follow) User-agent: * Disallow: /cgi-bin/ Disallow: /_private Disallow: /_fpclass Disallow: /_borders Disallow: /ssl Disallow: /webimages Disallow: /SFLib Disallow: /fpdb Disallow: /Backup Disallow: /test Disallow: /webtrends Disallow: /_images Disallow: /images Disallow: /Nav User-Agent: sitecheck.internetseer.com Disallow: /all User-Agent: semanticdiscovery/0.2 Disallow: /all User-Agent: LinkWalker Disallow: /all User-Agent: EmailSiphon Disallow: /all User-Agent: EmailCollector/1.0 Disallow: /all User-Agent: EmailWolf 1.00 Disallow: /all User-Agent: Explorer www@openxxx.net Disallow: /all User-Agent: ExtractorPro Disallow: /all User-Agent: WebBandit/*.* Disallow: /all ---- end (Contents above)