User-agent: Disallow: / User-agent: 8484 Boston Project v 1.0 Disallow: / User-agent: DBrowse 1.4b Disallow: / User-agent: DBrowse 1.4d Disallow: / User-agent: DSurf15a 71 Disallow: / User-agent: DSurf15a 81 Disallow: / User-agent: DSurf15a VA Disallow: / User-agent: DataCha0s/2.0 Disallow: / User-agent: Demo Bot DOT 16b Disallow: / User-agent: Demo Bot Z 16b Disallow: / User-agent: EBrowse 1.4b Disallow: / User-agent: ESurf15a 15 Disallow: / User-agent: Educate Search VxB Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf 1.00 Disallow: / User-agent: ExtractorPro Disallow: / User-agent: FSurf15a 01 Disallow: / User-agent: Full Web Bot 0416B Disallow: / User-agent: Full Web Bot 0516B Disallow: / User-agent: Full Web Bot 2816B Disallow: / User-agent: Guestbook Auto Submitter Disallow: / User-agent: ISC Systems iRc Search 2.1 Disallow: / User-agent: IUPUI Research Bot v 1.9a Disallow: / User-agent: LARBIN-EXPERIMENTAL (efp@gmx.net) Disallow: / User-agent: LMQueueBot/0.2 Disallow: / User-agent: LWP::Simple/5.803 Disallow: / User-agent: LetsCrawl.com/1.0 +http://letscrawl.com/ Disallow: / User-agent: Lincoln State Web Browser Disallow: / User-agent: MFC Foundation Class Library 4.0 Disallow: / User-agent: MVAClient Disallow: / User-agent: Mac Finder 1.0.xx Disallow: / User-agent: Microsoft URL Control - 6.00.8xxx Disallow: / User-agent: Missauga Locate 1.0.0 Disallow: / User-agent: Missigua Locator 1.9 Disallow: / User-agent: Missouri College Browse Disallow: / User-agent: Mizzu Labs 2.2 Disallow: / User-agent: Mozilla/3.0 (compatible) Disallow: / User-agent: Mozilla/3.0 (compatible; Indy Library) Disallow: / User-agent: Mozilla/4.0 (compatible; Advanced Email Extractor v2.xx) Disallow: / User-agent: atSpider/1.0 Disallow: / User-agent: autoemailspider Disallow: / User-agent: infoConveraCrawler/0.8 Disallow: / User-agent: * Disallow: /*.pdf$ Disallow: /*.Pdf$ Disallow: /*.PDF$ Disallow: /*.zip$ Disallow: /*.Zif$ Disallow: /*.ZIP$