I need some help:my site is under construction,and I don't want google spiders to index such a crippled website url and content, So ,I wrote a robots.txt: User-agent: * Disallow: / now I disallow all robots, are there any bad affect for google robots to index my site When my site is completed? Of course, I will remove (Disallow: /) when my site completed
Please note that the "User-agent:" syntax is using to control the Robots. So "user-agent:*" means you are allowing all robots. "Disallow:" is using to restrict the robots crawling from files & directories.
There will be no bad effect on your website by Google. You can use the robots.txt whenever necessary... it doesn't creates a bad impression.
I don't think that it cause any big issue as you are going 2 remove (Disallow: /) once your site is complete.
I'm sure there will be no bad effect,Google's orginally intention is encouraging webmasters to use this to manage their websites.