OK this bot has been on my site DAILY 24 hours a day in numbers averaging over 100 consistently for over 2 months straight.... Yes you read it right and the above is no exaggeration. It sucks loads of bandwidth and resources as I get j4krl.inktomisearch.com type bots browsing my pages in bulk constantly every day on a forum. What can I do to block this bot and is it a good idea? I know it's a .htaccess fix but anyone got example code and how fast do you think it would work?
Here're some .htaccess-based mod_rewrite examples: http://www.fleiner.com/bots/ Should work plenty fast enough
That should be easy enough to do with mod_rewrite, as well: just redirect instead of returning an invalid response ...come to think of it, send some my way as well, if you would
yeah man m facing the same problem inktomisearch.com is surfing ma site everyday in bulk its eat up lotsssssss of bandwith whats the solution guys esp whats that "inktomisearch.com"
lol this thread is 655 days old, anyway just block Inktomi in Robots text if the few cents bandwidth troubles you.
this thread is very old....I had the Inktomi Slurp Spider eating my bandwith I blocked it http://www.seo-rant.com/yahoo-inktomi-slurp-spider-eating-bandwith/