Hello there I have included my site to google webmaster tool and the it shows a crawl error like the following how can I fix this error? Looking forward to your answer thanks
I've had this problem before also and my problem was the robots txt. Check that out before moving forward.
Crawling errors are of many types like Server Error, 404 Error, Page not found Error etc. Server Error are the main errors so fix them first and others doesn't has more need to fix them. If this error comes from any outside domain/IP then you select that error link and click on Mark as fixed. but if this error comes from your own site/ domain then firstly fix this on server after that fix this in webmaster tool. Surely your problem will be solve.
Google can not find your page on the server. Are your page exist are not? You have to update your site map at once.
I have same problem but the difference is that the crawling error in my Google webmaster tool is around 99,000 approx. If I try to fix them it will take more than 4 months to get deleted because, only 1000 per day can be deleted and sometimes only 500 get deleted. Is there any way through which I can fix all 99,000 errors at once. Please Suggest Thanks
I think this would help you: http://www.seomoz.org/blog/how-to-fix-crawl-errors-in-google-webmaster-tools
Crawl errors is one of the most popular features in Webmaster Tools, and today we’re rolling out some very significant enhancements that will make it even more useful. We now detect and report many new types of errors. To help make sense of the new data, we’ve split the errors into two parts: site errors and URL errors. [h=2]Site Errors[/h]Site errors are errors that aren’t specific to a particular URL—they affect your entire site. These include DNS resolution failures, connectivity issues with your web server, and problems fetching your robots.txt file. We used to report these errors by URL, but that didn’t make a lot of sense because they aren’t specific to individual URLs—in fact, they prevent Googlebot from even requesting a URL! Instead, we now keep track of the failure rates for each type of site-wide error. We’ll also try to send you alerts when these errors become frequent enough that they warrant attention.
404 error means server could not find what was requested. You need to check your pages and remove the error and upload them.
googlebot can't find your page thats why webmaster tool is providing this mgs. Find out that page and write a code to robot.txt file to disallow that url. I guess doing this googlebot will not crawl the url and within a week webmaster tool will remove the notification.
I ran an on page optimization report of your site in website auditor. It says that the page you specified - comments/feed, is allowed for indexing (in robots.txt), but it says that it's an XML doc. XML language is used to store data, as opposed to HTML which is used to display data. So, it looks like some coding error. Who built your website? Why would your page be in XML?
I think you haven't updated your sitemap from a long time. It is because this page exists in your sitemap.xml file. Remove all the webpages which are not present from sitemap.xml and re submit it. All these types of errors will be fixed.