I have uploaded sitemaps for my site patriotsrush.com and few others but when I checked my google webmaster account it gave me the following error message. We were unable to crawl your Sitemap because we found a robots.txt file at the root of your site but were unable to download it. Please ensure that it is accessible or remove it completely. Im not sure why this is because I haven't uploaded a robots.txt file into any of the domains on my server and I checked to make sure there was nothing in there and there wasn't. What do I do to fix this? Until I can get it uploaded right google wont index the sites. Thanks a lot guys. Sean
When you try to download the robots.txt it returns a 500 error. Are you using a hosting service or do you have your own server. You should check your web server config and if apache .htaccess to see if you have something hardcoded to handle request for robots.txt
I haven't even used a robots.txt. Thats why it is confused. Google is saying they cant open it. I am new to a lot of this but isnt a robots.txt file for pages you dont want google to see? I have a Virtual Private Server.
one of them is patriotsrush.com but this is happening all of the sites in the network that I have completed so far. This was the first time I have used this sitemap creator could that be the problem?
I don't know what sitemap generator you are using? Are you using A1 Sitemap Generator? Anyways, I checked a few things quickly. 1) If you try check http://www.patriotsrush.com/robots.txt You will see it's giving an internal server error (500) Google's error message to you is misleading. They should simply have stated your webserver was throwing error response 500 when requesting the URL. Internal server errors are often caused by Apache .htaccess configuration errors (e.g. in mod_rewrite but it can be anything). you should check your webserver log! 2) By the way, I also noticed your website can be accessed from both http://patriotsrush.com/ and http://www.patriotsrush.com/ (you don't do a redirect)
OK I tried creating a blank robots.txt file and uploading it to my server and then resubmitted my sitemap but its still coming up with the error. Please someone help me out.
It's still odd that your webserver responded with error 500 before... But nontheless, I suggest you now wait a couple of days to see if Google's error goes away. It may take a little time for Google to update their status.
Just wanted to let you know this has been resolved. I added an allow to the robots.txt for my sitemap and it has not picked it up. Thanks for your help.
With the intention is an excellent suggestion, immediately formulate the robots.txt position to allocate the sitemap.