---- robots.txt (contents follow) User-agent: * Disallow: /cgi-bin/ Disallow: /bin Disallow: /anon_ftp Disallow: /error_docs Disallow: /logs Disallow: /pd Disallow: /webstat Disallow: /web_users Disallow: /webstat-ssl Disallow: /httpdocs/webstat Disallow: /httpdocs/graphics Disallow: /httpdocs/scripts Disallow: /cert Disallow: /conf ---- end (Contents above)