HI What it means in Google sitemap.... my website has 60 errors in this column.. Web crawl errors... like : HTTP errors 0 -- Not found 0 -- URLs not followed 0 -- URLs restricted by robots.txt 60 Details » URLs timed out 0 -- Unreachable URLs 0 Please explain me if it has any impact on SERP.......and which URL restricted by robots? Thanks
I guess its this site ?? --> ayhu.com take a look at http://www.ayhu.com/robots.txt User-agent: * Disallow: admin/ Disallow: includes/ Disallow: templates/ Disallow: logout.php Disallow: suggest-link.php Disallow: suggest-category.php
So does google sitemap shows those URL which has been disallowed in robort.txt ? I am worried if this due to other Problems....pls let me know how to get ride from this ? Thanks
delete the robots.txt and allow to crawl the whole site. BUT ist not a problem or an error so theres nothing you can do.
No, no need to be worried. Here some answers that may help you: http://www.google.com/support/webmasters/bin/answer.py?answer=35235&hl=en http://sitemaps.blogspot.com/2006/02/using-robotstxt-file.html