User-agent: * Disallow: /1999/ Disallow: /2000/ Disallow: /2001/ Disallow: /2002/ Disallow: /2003/ Disallow: /2004/ Disallow: /2005/ Disallow: /2006/ Disallow: /2007/ Disallow: /about.asp Disallow: /abouthand.asp Disallow: /abstract.asp Disallow: /admin/ Disallow: /ads/ Disallow: /articles/ Disallow: /asiapacific/ Disallow: /btnav.asp Disallow: /cod/ Disallow: /delete_regtype/ Disallow: /digest/ Disallow: /ehobonus/ Disallow: /event.asp Disallow: /errors/ Disallow: /feedback.asp Disallow: /giveaway/ Disallow: /graphics/ Disallow: /guide/ Disallow: /handbooks.asp Disallow: /images/ Disallow: /include/ Disallow: /left.asp Disallow: /link/ Disallow: /message_templates/ Disallow: /multimedia/ Disallow: /nav.asp Disallow: /news/ Disallow: /newsletters.asp Disallow: /pdf/ Disallow: /postcard.asp Disallow: /press/ Disallow: /promos/ Disallow: /quiz/ Disallow: /register.asp Disallow: /rightnav.asp Disallow: /section.asp Disallow: /scripts/ Disallow: /styles/ Disallow: /survey/ Disallow: /test/ Disallow: /us/ Disallow: /www/ Disallow: /upper.asp Disallow: /upper2.asp Disallow: /xtranav.asp User-agent: Googlebot-Image Disallow: / # Provided courtesy of http://browsers.garykeith.com. # Created on April 26, 2007 at 10:46:20 AM GMT. # # Place this file in the root public folder of your website. # It will stop the following bots from indexing your website. # User-agent: abot User-agent: ALeadSoftbot User-agent: BeijingCrawler User-agent: BilgiBot User-agent: bot User-agent: botlist User-agent: BOTW Spider User-agent: bumblebee User-agent: Bumblebee User-agent: BuzzRankingBot User-agent: Charlotte User-agent: Clushbot User-agent: Crawler User-agent: CydralSpider User-agent: DataFountains User-agent: DiamondBot User-agent: Dulance bot User-agent: DYNAMIC User-agent: EARTHCOM.info User-agent: EDI User-agent: envolk User-agent: Exabot User-agent: Exabot-Images User-agent: Exabot-Test User-agent: exactseek-pagereaper User-agent: Exalead NG User-agent: FANGCrawl User-agent: Feed::Find User-agent: Gigabot User-agent: GigabotSiteSearch User-agent: GurujiBot User-agent: Hatena Antenna User-agent: Hatena Bookmark User-agent: Hatena RSS User-agent: HatenaScreenshot User-agent: Helix User-agent: HiddenMarket User-agent: HyperEstraier User-agent: iaskspider User-agent: InfociousBot User-agent: iVia User-agent: iVia Page Fetcher User-agent: Jetbot User-agent: Kolinka Forum Search User-agent: KRetrieve User-agent: LetsCrawl.com User-agent: Lincoln State Web Browser User-agent: Links4US-Crawler User-agent: LOOQ User-agent: Lsearch/sondeur User-agent: MapoftheInternet.com User-agent: NationalDirectory User-agent: NetCarta_WebMapper User-agent: NewsGator User-agent: NextGenSearchBot User-agent: ng User-agent: nicebot User-agent: NP User-agent: NPBot User-agent: Nudelsalat User-agent: Nutch User-agent: OmniExplorer_Bot User-agent: OpenIntelligenceData User-agent: Oracle Enterprise Search User-agent: Pajaczek User-agent: panscient.com User-agent: PeerFactor 404 crawler User-agent: PeerFactor Crawler User-agent: PlantyNet User-agent: PlantyNet_WebRobot User-agent: plinki User-agent: PMAFind User-agent: Pogodak! User-agent: QuickFinder Crawler User-agent: Radiation Retriever User-agent: Reaper User-agent: RedCarpet User-agent: ScorpionBot User-agent: Scrubby User-agent: Scumbot User-agent: searchbot User-agent: Seeker.lookseek.com User-agent: SeznamBot User-agent: ShowXML User-agent: snap.com User-agent: snap.com beta crawler User-agent: Snapbot User-agent: SnapPreviewBot User-agent: sohu User-agent: SpankBot User-agent: Speedy Spider User-agent: Speedy_Spider User-agent: SpeedySpider User-agent: spider User-agent: SquigglebotBot User-agent: SurveyBot User-agent: SynapticSearch User-agent: T-H-U-N-D-E-R-S-T-O-N-E User-agent: Talkro Web-Shot User-agent: Tarantula User-agent: TerrawizBot User-agent: TheInformant User-agent: TMCrawler User-agent: TridentSpider User-agent: Tutorial Crawler User-agent: Twiceler User-agent: URI::Fetch User-agent: VengaBot User-agent: Vonna.com b o t User-agent: Vortex User-agent: Votay bot User-agent: WebAlta Crawler User-agent: Webbot User-agent: Webclipping.com User-agent: WebCorp User-agent: Webinator User-agent: WIRE User-agent: WISEbot User-agent: Xerka WebBot User-agent: XSpider User-agent: YodaoBot User-agent: Yoono User-agent: yoono Disallow: /