Stop ANY search engine indexing my site

[crazyryan]

Hey

How can I block any search engines from indexing my domain?

Thanks! :confused:

[catanich]

You could use the following in the robots.txt file:

User-agent: *
Disallow: *

But you really don't want to do this. What are you trying to do?

[crazyryan]

I want to block all search engines from indexing my site.

[shockie]

just disallow all crawlers as catanich suggested.

[thefourthroom]

User-agent: *
Disallow: /

Will do the thing

[ezcat]

Anyone know how to block just one bot and allow all others? I got a picture bot hitting my sites a couple times a day using several IPs

[Dreads]

Just ip ban them? using php, not very hard to do. Make something like this

<?php
$banip = "0.0.0.0";
$ip = GetHostByName($REMOTE_ADDR);
if ( $ip == $banip )
echo "
<META HTTP-EQUIV=Refresh CONTENT="0; URL=http://www.google.com">
";

?>

replace 0.0.0.0 with the ip that you wish to remove :P

[manish.chauhan]

Anyone know how to block just one bot and allow all others? I got a picture bot hitting my sites a couple times a day using several IPs

Use this robots.txt file:

User-agent: your bot name you want to block
Disallow: /

User-agent: *
Disallow: /your private files