Dio
Nov 23rd 2005, 9:08 am
I'm just trying this site http://www.botsense.com/ as I'm not an expert in bots and wouldn't know how to block a bad one. Basically you sign up and it generates a .htaccess file which does the job for the bad bots that ignore robots.txt
Anyone got any advice on this or think its a bad thing? I'm just trying it out on one of my sites at present.
Anyone got any advice on this or think its a bad thing? I'm just trying it out on one of my sites at present.