#Robot file User-agent: 80bot Disallow: / User-agent: A\ .NET Web Crawler Disallow: / User-agent: aipbot Disallow: / User-agent: amorphicCrawler Disallow: / User-agent: Art-Online.com\ 0.9(Beta) Disallow: / User-agent: asterias Disallow: / User-agent: BackDoorBot Disallow: / User-agent: baconsbot Disallow: / User-agent: Baiduspider Disallow: / User-agent: BecomeBot Disallow: / User-agent: Black.Hole Disallow: / User-agent: BlackWidow Disallow: / User-agent: bleeding-sucker-bot Disallow: / User-agent: boitho Disallow: / User-agent: Bot\ mailto:craftbot@yahoo.com Disallow: / User-agent: bot/1.0 Disallow: / User-agent: BotALot Disallow: / User-agent: BuiltBotTough Disallow: / User-agent: Bullseye Disallow: / User-agent: BunnySlippers Disallow: / User-agent: BWC/0.3 Disallow: / User-agent: CCBot Disallow: / User-agent: Caliperbot Disallow: / User-agent: CamelStampede Disallow: / User-agent: CazoodleBot Disallow: / User-agent: Chat Catcher Disallow: / User-agent: CherryPickerSE Disallow: / User-agent: CherryPickerElite Disallow: / User-agent: ChinaClaw Disallow: / User-agent: Clearware\ web\ browser Disallow: / User-agent: cn_com_viewer Disallow: / User-agent: com_viewer Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: Cowbot Disallow: / User-agent: Crescent Disallow: / User-agent: Custo Disallow: / User-agent: DIIbot/1.2 Disallow: / User-agent: DISCo Disallow: / User-agent: Distilled-Cache Disallow: / User-agent: Download\ Demon Disallow: / User-agent: dloader Disallow: / User-agent: dloader(NaverRobot)/1.5 Disallow: / User-agent: BorderManager Disallow: / User-agent: dotbot Disallow: / User-agent: DotBot Disallow: / User-agent: Drupal Disallow: / User-agent: Dumbot Disallow: / User-agent: ec_robot Disallow: / User-agent: eCairn-Grabber Disallow: / User-agent: eCatch Disallow: / User-agent: e-SocietyRobot Disallow: / User-agent: EirGrabber Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: EroCrawler Disallow: / User-agent: Exabot Disallow: / User-agent: Express\ WebPictures Disallow: / User-agent: ExtractorPro Disallow: / User-agent: EyeNetIE Disallow: / User-agent: FairShare Disallow: / User-agent: FlashGet Disallow: / User-agent: fr_crawler Disallow: / User-agent: Gaisbot Disallow: / User-agent: GazoPabot Disallow: / User-agent: Gazz Disallow: / User-agent: genieBot Disallow: / User-agent: Getleft Disallow: / User-agent: GetRight Disallow: / User-agent: GetWeb! Disallow: / User-agent: Ginxbot Disallow: / User-agent: Go!Zilla Disallow: / User-agent: Go.Zilla Disallow: / User-agent: Go-Ahead-Got-It Disallow: / User-agent: GrabNet Disallow: / User-agent: Grafula Disallow: / User-agent: grub-client Disallow: / User-agent: GrubNG Disallow: / User-agent: gsa-crawler Disallow: / User-agent: GurujiBot Disallow: / User-agent: Harvest Disallow: / User-agent: heritrix Disallow: / User-agent: HMView Disallow: / User-agent: HolmesBot Disallow: / User-agent: HTTrack Disallow: / User-agent: ichiro Disallow: / User-agent: Image\ Stripper Disallow: / User-agent: Image\ Sucker Disallow: / User-agent: ImageBot Disallow: / User-agent: Indy\ Library Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: InterGET Disallow: / User-agent: Internet\ Ninja Disallow: / User-agent: Isidorus Disallow: / User-agent: isiteamspider Disallow: / User-agent: Java Disallow: / User-agent: JennyBot Disallow: / User-agent: JetCar Disallow: / User-agent: JOC\ Web\ Spider Disallow: / User-agent: Jyxobot Disallow: / User-agent: kalooga/KaloogaBot Disallow: / User-agent: larbin Disallow: / User-agent: larbin_2.6.3 Disallow: / User-agent: larbin_2.6.2\ larbin2.6.2@unspecified.mail Disallow: / User-agent: larbin_2.6.3\ larbin2.6.3@unspecified.mail Disallow: / User-agent: LARBIN-EXPERIMENTAL Disallow: / User-agent: LargeSmall\ Crawler Disallow: / User-agent: LeechFTP Disallow: / User-agent: LexiBot Disallow: / User-agent: LexxeBot Disallow: / User-agent: librabot Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: linko Disallow: / User-agent: LinkScan Disallow: / User-agent: LinkWalker Disallow: / User-agent: LinkVerifier Disallow: / User-agent: Lickity_Split_Spider Disallow: / User-agent: lmspider Disallow: / User-agent: LWP::Simple Disallow: / User-agent: lwp-trivial Disallow: / User-agent: lwp-trivial/1.38 Disallow: / User-agent: lwp-trivial/1.40 Disallow: / User-agent: lwp-request Disallow: / User-agent: Magnet Disallow: / User-agent: Mag-Net Disallow: / User-agent: Mass\ Downloader Disallow: / User-agent: Mata.Hari Disallow: / User-agent: Memo Disallow: / User-agent: Metalogger Disallow: / User-agent: MIDown\ tool Disallow: / User-agent: MIIxpc Disallow: / User-agent: Mirror Disallow: / User-agent: Mister\ PiX Disallow: / User-agent: MLBot Disallow: / User-agent: Modiphibot Disallow: / User-agent: MojeekBot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: MSNPTC Disallow: / User-agent: NaverBot-1.0 Disallow: / User-agent: NaverRobot Disallow: / User-agent: Navroad Disallow: / User-agent: NearSite Disallow: / User-agent: NetAnts Disallow: / User-agent: NetSpider Disallow: / User-agent: Net\ Vampire Disallow: / User-agent: NetZIP Disallow: / User-agent: NICErsPRO Disallow: / User-agent: NL-Crawler Disallow: / User-agent: NoteworthyBot Disallow: / User-agent: noxtrumbot Disallow: / User-agent: NPBot Disallow: / User-agent: NutchCVS Disallow: / User-agent: Octopus Disallow: / User-agent: Offline\ Explorer Disallow: / User-agent: Offline\ Navigator Disallow: / User-agent: OOZBOT Disallow: / User-agent: Openfind Disallow: / User-agent: PageGrabber Disallow: / User-agent: page-store Disallow: / User-agent: Papa\ Foto Disallow: / User-agent: P.Arthur 1.1 Disallow: / User-agent: pavuk Disallow: / User-agent: pcBrowser Disallow: / User-agent: PDFBot Disallow: / User-agent: Peter\ Wang/Nutch-0.9 Disallow: / User-agent: Pita Disallow: / User-agent: Pockey-GetHTML/4.11.6 Disallow: / User-agent: Pockey-GetHTML Disallow: / User-agent: POPrlBot Disallow: / User-agent: ProPowerBot/2.14 Disallow: / User-agent: Program Shareware Disallow: / User-agent: ProWebWalker Disallow: / User-agent: psbot Disallow: / User-agent: Python-urllib Disallow: / User-agent: QueryN.Metasearch Disallow: / User-agent: QuepasaCreep Disallow: / User-agent: rdfbot Disallow: / User-agent: R6_CommentReader Disallow: / User-agent: RealDownload Disallow: / User-agent: ReGet Disallow: / User-agent: renlifangbot Disallow: / User-agent: RepoMonkey Disallow: / User-agent: RMA Disallow: / User-agent: OutfoxBot Disallow: / User-agent: ScooperBot Disallow: / User-agent: sherlock Disallow: / User-agent: SimpleCrawler Disallow: / User-agent: Siphon Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: ShablastBot Disallow: / User-agent: SiteSnagger Disallow: / User-agent: SiteSucker Disallow: / User-agent: Sisi Disallow: / User-agent: SlySearch Disallow: / User-agent: SmartDownload Disallow: / User-agent: sna-0.0.1 Disallow: / User-agent: sna-0.0.1\ mikeelliott@hotmail.com Disallow: / User-agent: Snapbot Disallow: / User-agent: SnapPreviewBot Disallow: / User-agent: Sosoblogspider Disallow: / User-agent: Sosospider Disallow: / User-agent: spanner Disallow: / User-agent: Space\ Bison Disallow: / User-agent: Speedy\ Spider Disallow: / User-agent: Sphere\ Scout Disallow: / User-agent: Spinn3r Disallow: / User-agent: SqwidgeBot Disallow: / User-agent: SuperBot Disallow: / User-agent: SuperHTTP Disallow: / User-agent: Surfbot Disallow: / User-agent: suzuran Disallow: / User-agent: SygolBot Disallow: / User-agent: Szukacz/1.4 Disallow: / User-agent: TailsweepBot Disallow: / User-agent: tAkeOut Disallow: / User-agent: TapuzBot Disallow: / User-agent: Tarantula\ Experimental\ Crawler Disallow: / User-agent: telnet Disallow: / User-agent: Teleport\ Pro Disallow: / User-agent: Telesoft Disallow: / User-agent: The.Intraformant Disallow: / User-agent: TheNomad Disallow: / User-agent: TightTwatBot Disallow: / User-agent: Titan Disallow: / User-agent: toCrawl/UrlDispatcher Disallow: / User-agent: True_Robot Disallow: / User-agent: turingos Disallow: / User-agent: Twiceler Disallow: / User-agent: URLy.Warning Disallow: / User-agent: VoilaBot Disallow: / User-agent: VoidEYE Disallow: / User-agent: voyager Disallow: / User-agent: Watchfire\ WebXM Disallow: / User-agent: Web\ Image\ Collector Disallow: / User-agent: Web\ Sucker Disallow: / User-agent: WebAlta Crawler Disallow: / User-agent: WebAuto Disallow: / User-agent: WebBandit Disallow: / User-agent: Webclipping Disallow: / User-agent: WebCopier Disallow: / User-agent: WebEMailExtrac Disallow: / User-agent: WebEnhancer Disallow: / User-agent: WebFetch Disallow: / User-agent: WebGo\ IS Disallow: / User-agent: webcollage Disallow: / User-agent: Web.Image.Collector Disallow: / User-agent: WebLeacher Disallow: / User-agent: WebmasterWorldForumBot Disallow: / User-agent: WebReaper Disallow: / User-agent: WebSauger Disallow: / User-agent: Website\ eXtractor Disallow: / User-agent: Website\ Quester Disallow: / User-agent: Webster.Pro Disallow: / User-agent: WebStripper Disallow: / User-agent: WebWhacker Disallow: / User-agent: WebZIP Disallow: / User-agent: Wget Disallow: / User-agent: Wget/1.8.2 Disallow: / User-agent: Wells\ Search\ II Disallow: / User-agent: West\ Wind\ Internet\ Protocols Disallow: / User-agent: Widow Disallow: / User-agent: WordPress Disallow: / User-agent: WordPress\/2.6.2 Disallow: / User-agent: [Ww]eb[Bb]andit Disallow: / User-agent: WWWOFFLE Disallow: / User-agent: WWW-Collector-E Disallow: / User-agent: Xaldon\ WebSpider Disallow: / User-agent: Xenu Disallow: / User-agent: Xenu\ Link\ Sleuth Disallow: / User-agent: xrss Disallow: / User-agent: yacy Disallow: / User-agent: yacybot Disallow: / User-agent: Yandex Disallow: / User-agent: Yanga\ WorldSearch\ Bot Disallow: / User-agent: YebolBot Disallow: / User-agent: Yeti/1.0 Disallow: / User-agent: YodaoBot Disallow: / User-agent: xMind Disallow: / User-agent: Zeus Disallow: / User-agent: zibber Disallow: / User-agent: zibber-v0.1 Disallow: / User-agent: ZixyBot Disallow: / User-agent: * Disallow: /botrack/ Disallow: /banner/ Disallow: /banner/ads/ Disallow: /cartoon/ Disallow: /cgi-bin/ Disallow: /etc/ Disallow: /forum/ Disallow: /graham/ Disallow: /home/ Disallow: /images/ Disallow: /includes/ Disallow: /joerobertsband/ Disallow: /kc/update/ Disallow: /kc/ssi/ Disallow: /masthead/ Disallow: /mlm/ Disallow: /news/_admins/ Disallow: /news/_inc/ Disallow: /news/_mods/ Disallow: /news/_themes/ Disallow: /news/forum/ Disallow: /news/images/ Disallow: /news/infozine/includes/ Disallow: /news/poll/ Disallow: /news/utilities/ Disallow: /news/admins.php/ Disallow: /news/administration.php/ Disallow: /news/bio_admin_image_upload.cgi/ Disallow: /news/bio_admin_image_upload.php/ Disallow: /news/form.php/ Disallow: /news/login.php/ Disallow: /news/logout.php/ Disallow: /news/image_upload.php/ Disallow: /news/image_AEView_upload.php/ Disallow: /news/image_AEView_upload.cgi/ Disallow: /news/missing.php/ Disallow: /news/preload.php/ Disallow: /news/tmp/ Disallow: /news/xml/ Disallow: /news/zads/ Disallow: /news/upload.cgi/ Disallow: /pics/ Disallow: /real/ Disallow: /search/ Disallow: /style/ Disallow: /test/ Disallow: /tmp/ Disallow: /toc/ Disallow: /update/