You could use the following in the robots.txt file: User-agent: * Disallow: * But you really don't want to do this. What are you trying to do?
Anyone know how to block just one bot and allow all others? I got a picture bot hitting my sites a couple times a day using several IPs
Just ip ban them? using php, not very hard to do. Make something like this <?php $banip = "0.0.0.0"; $ip = GetHostByName($REMOTE_ADDR); if ( $ip == $banip ) echo " <META HTTP-EQUIV=Refresh CONTENT="0; URL=http://www.google.com"> "; ?> replace 0.0.0.0 with the ip that you wish to remove
Use this robots.txt file: User-agent: your bot name you want to block Disallow: / User-agent: * Disallow: /your private files