As part of my traffic directory experiments, I need to know on average how many times does google crawl a directory site on average. How many times does google crawl your site on average?
Go to this site seometer.com and you can check yourself Update - I just checked a few sites and it may not be working now...
i have 1 directory that are 2 years old i get daily crawled by google anytime timethe site get update
I hate to disagree with one who has 8K posts but I don't think cache date and spider date are related. I go by awstats. PUXX gets updated daily and Googlebot visited today. The cache date is Nov. 16 and differs considerably from the current index page. 2 other sites were visited yesterday. I am getting so used to my stable of sites getting spidered on a regular basis that I don't pay lots of attention. But G gets my attention quickly when I fall in the SERPS.
Google crawls your site every time it finds a backlink leading to it. It only caches it every few days or if the page has updated, AFAIK.
I get crawled 9000 times a month by Google, used to be 30'000 a month. Slurp crawls us more at 28'000 a month. Other spiders crawl us about 23'000 each month in total.
My RSS gets crawled everyday and so does the latest link page. I should make the first page more dynamic @Harkster: Your disagreeing is correct, I don't see my page being cached though the logs they google bot paid a visit.
HI My directory also gets crawled daily by Google and Yahoo... but gets the most traffic from Google.. Tom
Couldn't agree more, but the OP wasn't asking how frequently googlebot visits, just when it last visited. Without context that means nothing either. Actually the question then became which is equally hard to answer because I don't understand the question. Now, if you don't have the cooperation of the owner (like us) you can still get a feel for how often a site is being indexed by looking at it's cache date. That's all I was meaning.