User-agent: ia_archiver Disallow: / User-agent: * Disallow: /forums User-agent: * Disallow: /KnowledgeBase User-agent: fast Disallow: / User-agent: NPBot Disallow: / User-agent: ecollector Disallow: / User-agent: psbot Disallow: / User-agent: Exabot Crawl-Delay: 60 Disallow: / User-Agent: msnbot Crawl-Delay: 20 User-Agent: snap.com beta crawler v0 Disallow: / User-Agent: Mozilla/5.0 (Version: xxxx Type:xx) Disallow: / User-Agent: atSpider/1.0 Disallow: / User-Agent: autoemailspider Disallow: / User-Agent: combine/0.0 Disallow: / User-Agent: Combine/x.0 Disallow: / User-Agent: ContentSmartz Disallow: / User-Agent: DataCha0s/2.0 Disallow: / User-Agent: DBrowse 1.4b Disallow: / User-Agent: DBrowse 1.4d Disallow: / User-Agent: Demo Bot DOT 16b Disallow: / User-Agent: Demo Bot Z 16b Disallow: / User-Agent: DSurf15a 01 Disallow: / User-Agent: DSurf15a 71 Disallow: / User-Agent: DSurf15a 81 Disallow: / User-Agent: DSurf15a VA Disallow: / User-Agent: EBrowse 1.4b Disallow: / User-Agent: Educate Search VxB Disallow: / User-Agent: EmailSiphon Disallow: / User-Agent: EmailWolf 1.00 Disallow: / User-Agent: ESurf15a 15 Disallow: / User-Agent: ExtractorPro Disallow: / User-Agent: Franklin Locator 1.8 Disallow: / User-Agent: FSurf15a 01 Disallow: / User-Agent: Full Web Bot 0416B Disallow: / User-Agent: Full Web Bot 0516B Disallow: / User-Agent: Full Web Bot 2816B Disallow: / User-Agent: Industry Program 1.0.x Disallow: / User-Agent: infoConveraCrawler/0.8 ( http://www.authoritativeweb.com/crawl) Disallow: / User-Agent: IUPUI Research Bot v 1.9a Disallow: / User-Agent: LARBIN-EXPERIMENTAL (efp@gmx.net) Disallow: / User-Agent: LWP::Simple/5.803 Disallow: / User-Agent: Mac Finder 1.0.xx Disallow: / User-Agent: MFC Foundation Class Library 4.0 Disallow: / User-Agent: Microsoft URL Control - 6.00.8xxx Disallow: / User-Agent: Missauga Locate 1.0.0 Disallow: / User-Agent: Missigua Locator 1.9 Disallow: / User-Agent: Missouri College Browse Disallow: / User-Agent: Mizzu Labs 2.2 Disallow: / User-Agent: Mozilla/2.0 (compatible; NEWT ActiveX; Win32) Disallow: / User-Agent: Mozilla/3.0 (compatible) Disallow: / User-Agent: Mozilla/3.0 (compatible; Indy Library) Disallow: / User-Agent: Mozilla/4.0 (compatible; Advanced Email Extractor v2.xx) Disallow: / User-Agent: Mozilla/4.0 (compatible; Iplexx Spider/1.0 http://www.iplexx.at) Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 5.0; Windows NT; DigExt; DTS Agent Disallow: / User-Agent: Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request Disallow: / User-Agent: Mozilla/4.0 efp@gmx.net Disallow: / User-Agent: PBrowse 1.4b Disallow: / User-Agent: PEval 1.4b Disallow: / User-Agent: Poirot Disallow: / User-Agent: Port Huron Labs Disallow: / User-Agent: Production Bot 0116B Disallow: / User-Agent: Production Bot 2016B Disallow: / User-Agent: Production Bot DOT 3016B Disallow: / User-Agent: Program Shareware 1.0.2 Disallow: / User-Agent: PSurf15a 11 Disallow: / User-Agent: RSurf15a 41 Disallow: / User-Agent: RSurf15a 51 Disallow: / User-Agent: RSurf15a 81 Disallow: / User-Agent: SSurf15a 11 Disallow: / User-Agent: TSurf15a 11 Disallow: / User-Agent: Under the Rainbow 2.2 Disallow: / User-Agent: Wells Search II Disallow: / User-Agent: WEP Search 00 Disallow: /