Hello, i want to test website in internet and show it to my client, before he pays for it (and gets files), but i dont want that it appear in any search engines before it is in correct aadress. Maybe it hurts future search engine results if website is moved between two addreses.... What to do?
There are many ways for preventing crawling of your website like >> You can block search engine bots crawling your website through .htaccess file. You can take help of your webhosting provider in this regards. If you need to keep website data confidential then you can also save it in a password-protected directory. Googlebot and other spiders won't be able to access the content. You can also use robots.txt which control the access of bots to files and directories on your server.
Very easy, using Google Webmaster tool you can easy prevent crawling for certain pages or website itself.
Thank you all for replies. But if i block SE for a short time, doesnt it somehow block that website when it is finally in correct aadress? This short time blocking is not somehow against google rules? I just in case ask.
hi,Why you want to avoid search engines? May i know the valid reason for that? I'll help you in this issues
How to use .htaccess to dissallow particular bot ? because I think bad bots like Email-crawllers doesn't follow robots.txt file.
I still suggest that robots.txt is the best method and it is easy to apply too. Drop a visit here if you get the chance: www.robotstxt.org
You can block search engine bots crawling your website through .htaccess file. You can take help of your webhosting provider or using Google Webmaster tool you can easy prevent crawling for certain pages or website.