I am very thankful to this community who help me step by step. My question is - My site is under development but still in google index and has some inbound links which send me a little traffic. But I don,t want to show my under development site to my visitors so i put htaccess password protection. Will it penalize my site by SE Thanks again
if you dont want search engines to index your pages now, block your pages with robots.txt file. it's easier and using password protected pages will not be a reason for the punishment
robots.txt can prevent bots only i aslo wanted to stop visitors from browsing my under contruction site
There is no easy way how to block visitors only. It can be done by some scripting only. 1) by detecting bot (you will need comprehensive list) 2) by testing with cookies (bots are not able to use them)