Hi all, Within my Google Webmasters Tools page a few of my sites come back with the following error: But my sites are up and running so why the error? Also I've noticed that Google has stopped indexing the sites and when I do a site:xxx.xxx no site info shows. Any ideas? Regards.
I'm not experiencing any problems. Have you upload a site map and robots.txt file to help the google bots crawl your site easier? Also have to changed the crawler speed, if so, set it back to low and this might help. Google bots take up a alot of bandwidth when crawling so this may also account for it
Are the pages that are in question being generated via multiple database / server queries? If they are it could be taking a longer than expected time to load these pages. A good example is a forum or blog. When google accesses these pages it can actually have multiple queries that have to process in order for the page to load. The page size may actually show as being small like 30Kb but takes 10+ seconds to load due to the queries taking so long to complete on shared hosting accounts or bad servers. googlebot does not like to wait for pages and if it takes longer than it expects based on page size it considers the page or server to be experiencing problems. This is my theory but I have heard a few others kick this around too. Hope this helps.