These are the bots that visits my site., Yahoo MSNBot Templeton GoogleBot InternetSeer MSIECrawler Ask Jeeves AvantGo WISEnut Baidu BorderManager Alexa Crawler Gigablast Robot Voyager Voila.fr Robot Larbin GirafaBot WebTrends motor Teoma Openfind data gatherer Checkbot Wget webs Naver Robot Overture/Fast/All the Web Crawler nomad Indy Library AltaVista ASpider SurveyBot Netcraft ARKS Pegasus Python Missigua Locator EMAILSIPHON WebReader Indonesia Interactive Lycos GaisBot ObjectsSearch Zeus Internet Marketing Robot Almaden LinkScan Converas RetrievalWare Internet Spider PlantyNet Combine Harvesting Robot RuLeS M-Crawler NameProtect Inc. Web Crawler Slider Ilse Szukacz SpiderView Grub Goo Japan Pioneer monster NDSpider JoBo Advanced Email Extractor Singingfish Media Spider Keywen Encyclopedia Bot Picsearch TurnitinBot NetMechanic Magpie Applied Semantics Auto-Categorizer for QWestDex Direct Brandimensions Robot Of these which do you think are bad and ugly bots., Good - Just like Google , yahoo and msn Bad - No use Traffic wise Ugly - Fuc***** spam bots Iam thinking of blocking the bad and ugly via robots.txt Also please provide the bad and ugly bots that you have Thanks Sarathy.s
I don't know most of those, but I would remove the ones below. I don't know them either, but the namesscream "block me" Advanced Email Extractor Openfind data gatherer EMAILSIPHON