How do i remove more than 100Ks of crawl error that shows up on my google webmasters tool? We lost our site a few months ago with all the database. So we created a new website from base. But now Google shows all the old pages as missing pages. How do I remove them all together? I know Google allows you to submit an URL for removal from its indexes, but I have more than 100,000 links there!
It seems to me (and someone will likely have a better idea or correct me) that updates to sitemaps and crawl errors disappear over time. It seems to me as though Google doesn't instantly fix crawl errors and that the crawlers tend to try to crawl certain URLs even after you fix them or delete them. Over time though, I've seen that once I've marked them as fixed it takes a few weeks but eventually it will stop crawling them. At least, that's what I've noticed.
Yes over time with a valid sitemap they will clear up but I doubt that many would clear up in a few weeks. If you're using WordPress, you should install a 404 redirect plugin. There are ones that will simply redirect all 404's to the homepage and ones that will redirect 404's to the page it thinks matches the best and ones that you can create redirects manually right from the 404 logs. With that many pages you probably don't want to create thousands of manual redirects but maybe you can hire a VA to do it for cheap.
Here are solutions for you: Redirect all url which cause errors to their new page using 301 redirection. Ex: domain.com/old-url to domain.com/new-url If you didn't have that page, just redirect them all to specific pages such as 'HomePage' or page specially to 'handle errors'. It is best to create page that list all the content and redirect all errors to that page. I do myself prefer redirection to frontpage. Reference: I got more than 45.000 errors after my local hosting crashed. All contents completely wiped out and I only have a backup created a year before. I redirect all the errors to homepage and take the content from Google cache. A manual work. I could only save less than 43% and give up. Avoid deleting links. Don't delete the links via Google Web Master Tools (if possible). Think about it, your links maybe very useful because so many sites linking to that links. If you delete the links, you will lose their 'votes' which mean you will lose the 'link juice'. Redirecting to homepage will boost and supercharge your domain. Don't block the errors with robots.txt If you block it, the errors will stay there and over time it will disappear but you will also lose 'link juice'. Most peoples give this solution because they think the error is just error that give no value to the site. However, we should understand if each link have their own values. If you block it, the value will be gone forever. This is why I suggest to '301 permanent redirect' it. By redirecting to their new places using .htaccess or 404.php, Google and most SE would think the errors already being solved for good and the site will be ranked high again as it used to be. Redirection to homepage/special page is second best solution if redirecting to new page is not possible. After you create the redirection, just click 'Mark As Fixed' to tell SE if the problem already fixed. Bots will check it and the appear will be gone forever. You don't need to do this because the errors will disappear after Bots re-crawl the url again.
website owners have requested for the resources of the URLs resulting in the mistakes. Well, we're listening! We know it was challenging for those of you who desired to recognize the cause of a particular "Not found" mistake, to avoid it later on or even to demand a modification, without understanding the resource URL.