I have a sitemap set up for my mediawiki site. The sitemap is refreshed with a cron job every 24 hours. My question is, how often does google check sitemaps? Thanks in advance for any advice you can give
If your update your site and sitemap frequently, google will smartly update and visit your sitemap frequently. we could see from webmaster tools. There is a similar tools in yahoo. It is called siteexplorer. yahoo bot are lazy to crawl your sitemap and rss feed.We could also see from the backend panel.
I don't believe that google crawler visits has anything to do with how often your sitemap is submitted. Like Tom said, my site also receive visits every 6-7 days and index 10 to 20 pages at each visit. This independently if I submit the sitemap often or not. And like justinlorder said: Google crawler is very lazy. In fact you can diminish the number of visits of the crawler from Normal to Slower in Dashboard > Tools > Set crawl rate, but you cannot raise it to Faster. The rate at which Googlebot crawls is based on many factors. At this time, crawl rate is not a factor in your site's crawl. If it becomes a factor, the Faster option below will become available.. I guess this is as much information as we will get!
If you are using a CRON job, then that service when finished should Ping Google. G will then read it within the hour.
I am using sitemap on http://reviewgooglechrome.com/sitemap.xml. I am using a plugin Google XML sitemaps. Its working fine but still Google has not indexed all of my pages yet. Its a new site. Any ideas?
The webmaster tool can tell you the frequency of spider visit and I am getting it bit slow. I think they are lazy to crawl.
yea webmaster tools helped alot i submited the sitemap there and now my website is indexed (i think all the pages are now on google).
Capt. Ramius: Give me a ping, Vasily. One ping only please! http://www.google.com/webmasters/sitemaps/ping?sitemap=http://www.yourdomain.com/sitemap.xml
I find submit sitemap on Google have no positive effect, even that affect negatively on my site. My site first submit on Google then get error then never indexed, indexed urls is always is zero. If anybody has same problem as mine then we can discuss deeply. Follow my individual opinion sitemap then sitemap is useless.