Webmaster tools robots.txt problems

Hi everyone, I just moved my wordpress site to a new host this week, I got a error message at webmaster tools during that time that google bot couldn't access my robots.txt, problaby because we suffered a couple of hours of downtime. After the migration I fetched robots.txt it as google and it says success but the error message "Google couldn't crawl your site because we weren't able to access robots.txt" keeps staying there.

This week it the warning changed to a yellow exclamation point. Anyone have any experience in getting this error message to go away? After the date of the errors there are no red dots or blue dots that says failed attempts on my webmaster tool graph.

I should mention that the only thing at my robots.txt currently is

#Begin Attracta SEO Tools Sitemap. Do not remove
sitemap: cdn.attracta.com/sitemap/url.xml.gz
#End Attracta SEO Tools Sitemap. Do not remove

Anyone with any experience with this kind of issues? Is there something wrong with my robots.txt? How long does it usually take for webmaster tools to show that the issue have been solved?

I have attached the graph from my webmaster tool. Any insight would be much appreciated.

 

I have the same issued faced a year before, My hosting provider told, that they don't have any hosting issue, but I have faced lot of downtime, thus this issue happenes, Ask your hosting provider and keep watch on site downtime. Also check your robot.txt file, it should be clean...

 

sometime in after changing host, google still determine same thing and won't update error or graph for some days. in few days check this again and you'll be fine with your site permissions

 

Try to remove robots.txt and rewrite it.

 

Add this on the top of your robot.txt:

User-agent: *

Code (markup):

So that it allows all of search engines to crawl your website and if you have specific folders on your host that you don't want any search engines to crawl then you would have to change and add like in this example:

User-agent: *
Disallow: /media

Code (markup):

/media is a example and often people would use that folder to upload images, videos and audios in that directory but if you use that code it would prevent all search engines from crawling and index your multimedia files on their search engines for anyone to steal.

You can add Disallow: then put any folders or pages that you do NOT want any search engines to crawl and possibly index but if you want crawlers to crawl the entire of your website freely then go with the first code I provided above.

But if you have migrated websites to a new web hosting, give it a time and that warning/alert message will go away as it may take few days or weeks. Took about a week for me.

 

you go to your word press web site setting and found search setting update their your robots file .For more information http://codex.wordpress.org/Search_Engine_Optimization_for_WordPress