Hello Everyone, I have a blog with custom domain name at blogger. The blog had previously a different custom domain name, but it got expired and now I have purchased a new domain which I am using for my blog at blogger. I added the sitemap with atom.xml file to google webmaster tools around 4 to 5 days back. The status of sitemap is shown with green tick which means sitemap is correct. But, my blog is not yet crawled by Google. I want to know how can get my blog crawled or is there any problem. The robots.txt file that is generated by blogger displays following text: User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search Allow: / Sitemap: http://www.name of my blog.com/feeds/posts/default?orderby=updated I want to know whether anything is wrong with the robots.txt file. I want to get my blog crawled. Please help me with this.
I am not sure but, I doubt there is some issue with your robot.txt file. Remove search from "Disallow". According to the information you have provided, I assume that you have recently changed your domain, there is also a rare possibility that your domain was previously banned by Google, that's only a wild guess so, do the changes in robot file and check whether your issue is resolved.
Thanks for the information. But, I can not change the robots.txt file as I have my blog hosted by blogger. Do you know how to change robots.txt file of blogger.
In the mean time have a look at a similar thread here: http://forums.digitalpoint.com/showthread.php?t=422059 Hope this helps.