User-agent: WebZIP Disallow: / User-agent: WebStripper Disallow: / User-agent: Teleport Pro Disallow: / User-agent: Wget Disallow: / User-agent: eCatch Disallow: / User-agent: WebCopier Disallow: / Disallow: /flash/ Disallow: /cgi-bin/ Disallow: /images/ Disallow: /icons/ # exclude help system from robots User-agent: * Disallow: /scripts/ # but allow htdig to index our doc-tree User-agent: susedig Disallow: # disallow stress test user-agent: stress-agent Disallow: /