Hi, in my stats I see the following for november: Vermutlich Roboter/Spider 12'886 87.7 % 12'886 269.41 MB 1.00 2008-Nov-30 Yahoo Slurp 5'125 410 33.22 MB 2008-Nov-30 Googlebot 3'655 34 43.10 MB 2008-Nov-30 Java (Often spam bot) 2'088 0 43.60 MB 2008-Nov-30 Unknown robot (identified by 'robot') 1'176 49 16.33 MB 2008-Nov-29 How can I tell Yahoo and Google to not use that much traffic and who is the Java bot? Is it really a Spambot? How can I avoid the java bot from visiting my site? Thank you in advance. Bye, Energie2Null
stats code always don't have such powerful stats function to trace robots . However google webmaster tools can tell you when googlebot visit you . In google webmaster tools , you can give instruction to googlebot and tell it how often to visit your site . It only works for googlebot .
Yes, ok .. that's only for Google. But what can I do with the other one? Especially with the java one? Is there a general way to block Spam bots besides using Captcha?
Can someone explain how these bots work. I know the basics but not enough to know wether or not they are worth it.