I have created a blog and using Wordpress on there. Just 1 page was crawled and I changed my theme. But I don't know why the robots.txt file was changed automatically. It looks like: User-agent: * Disallow: / However later i changed my robots.txt file as: User-agent: * Disallow: It is the correct format of allowing all of the robots I think. But the sad things is that......though i have added lots of pages and posts on my blog; none of the posts are indexing. It is worth-mentioning that i have changed this just 1 day before. So my question is that how long will the Search Engines take time to be acquainted of my changed robots.txt? Is there any wrong else? Help.