I bought the domain already for a new website and I am slowly adding new features and content. I don't want Google to crawl it now, either because there are few pages or I am going to change the link structure later. Is there a way to "block" Google from indexing my page? I know about robots.txt, but I don't know if it's permanent. If I tell Google (or any other search engine) to don't crawl my website, will they come back when I remove/edit my robots.txt? I guess I am looking for a temporary solution to block search engine crawling. Many thanks to all,
I would use <meta name="robots" content="NOINDEX,NOFOLLOW"> then change it to <meta name="robots" content="INDEX,FOLLOW"> when you're ready to be indexed.
My suggestion is to use robots.txt. The blocking effect will be on only when your txt file stated so. Therefore, this is temporary. Regarding your next question, how frequently google bots index your site depends on how often you change your content and the pagerank of your page. You can fing the bots visiting your site everyday if you have fresh content and a high pagerank So use robots.txt to your advantage
I would put up a temporary site so you can get indexed and develop the main site in another directory.