Three weeks ago I installed yahooanswer script into my hosting: Hostmonster. Right now, the website is online www.metroadvice.com, but its having problem. Which is, the main url/domain name is indexed on Google, but the rest 116 posts and articles are not indexed at all. When I check the www.metroadvice.com/robots.txt, it gave me weird error. I did submit sitemaps on google webmaster tools, and it give me error, http://www.metroadvice .com/category/Health/1 robots.txt unreachable Sep 4, 2009 I did ask on google forum, they told me to talk to my hosting company, but then Hostmonster told me to find developer or someone who can fix this. Anyone interested? Please message me with the price
your robots.txt is empty...delete it simply and then resubmit your sitemap to google and then ping google
I did submit my sitemap. BUt stil. all the pages having status "unreachable". The robots.txt status is now 200(success). I know google robots does visit my website, but somehow they cant reach my pages.The sitemap.xml now is OK, but sometimes it failed, and i had to resubmit. ABout 57 urls are having error and unreachable. These are the 2 detail: PS: please dont message me about how to upload the robots.txt, I know how to do it. And thats not the matter. The problem is.. how to fix the crawl error and the unreachable pages. Anyone can help?