I have problem with my Google Webmaster Tool. What google says: Errors for URLs in Sitemaps : 33 Unreachable URLs : 88 For the details on Errors for URLs in Sitemaps & Unreachable URLs, all are showing robots.txt unreachable. On my sitemap it's showing error status: Network unreachable: robots.txt unreachable We were unable to crawl your Sitemap because we found a robots.txt file at the root of your site but were unable to download it. Please ensure that it is accessible or remove it completely. I did not have any robots.txt files uploaded. Why is this happening? Any helps please!?
make sure that the sitemap you submitted is correct, and the url you entered is available... and check out by typing robots.txt after your site url, if you find any, you can correct with a tool available in google webmaster its name something like robot txt generator..
The sitemap is correct, the url i entered is available, I have not upload any robots.txt file. Everything is fine until this morning.
How did you generate the sitemap? If not, then upload one and allow the robots to access all the files...
i would suggest to delete your uploaded sitemap and resubmit another one instead right away. , if this dont work delete the unreachable URL's from your website. Good luck.
Hi, thanks for your reply, I generated sitemap through this site http://www.xml-sitemaps.com/ Can you let me know what should I put on the robots.txt file in order to let it to access all the files? I have done it, but it still doesn't work. My whole site is unreachable by the bot. I have read on some post about this problem, someone told me it's the web hosting problem and ask me to switch my hosting...
Sometimes, error on sitemap crawling might due to server down on the time google crawler reach our pages. Some unreachable url will simply be ignored by their spider as it could interrupt the crawling progress.