Has anyone noticed Googlebot inactivity? It used to spider one of my pages every day, and it's now been 6 days without it. Or maybe they changed IP address?
I guess this could also depend on backlinks? If Google follows a backlink to ur site, it enters ur site? Good sites with many backlinks have more google visits?
I'm just the opposit. Googlebot hit me 103 times yesterday. Didn't go deep though. So far only 1 visit today. MSN got more active for me yesterday also. Came in 7 times and made relatively deep crawls. Maybe it will help? My serps stink in MSN.
On my blog, I get around 60-70 visits a day... That number doesn't appear to have changes. <edit> Just A thought Crear... When was the last time you updated your site (Or the page in question) It may be the case that it hasn't changed for a while, so the Gbot has decided to give it a little break in visiting your site.
No, it doesn't work like that. It uses a quite sophisticated ordering process of links. It actually prioritizes more important links and destination pages according to PR etc. When spidering, all it does at first is collecting links. Those links enter a database which is sorted based on a priority algorithm. Other spiders will then take each link and index it plus put new found links in that list. But yes, pages with many IBL's will get more visits indeed. Hence the high-PR advantage (about the only advantage of high PR but is a straight result from having many IBLs).
Is this just theory or do you have some references to show that Google spiders this way? I would be very surprised if Googlebot would visit a page twice in order to spider it once. IMO the URL server has all the data it needs from previous crawls to prioritize crawling the way it thinks best.
I have noticed a decrease, actually. I've got a vb3 (previously a vb2) that used to have dozens of spiders coming daily, now it's usually only a few times a week I see them- and when they do show up, there's usually only a few on at a time.
Googlebot does seem to have days when it spiders like a tornado and others when it is almost dozy, but this depends on the site, and in particular how much and how often the content changes. For a while on my forum, I was seeing a pattern where it was going nuts on Tuesdays, with something between a third and half of the hits for the week during that 24 hour period... almost spooky but it may well have been a function of increased posting activity on Mondays following the weekends...
Based on Stanford Uni and Google and other crawling whitepapers. So no, not 100% sure this is fact but just indexing whatever you come across is downright a stupid system. See this Stanford paper and see this Mercator paper which has this nice graphic representation of url sorting: Mecator is an advanced spider like Google. Though not the exact same.
Ive had gbot every day since 9 Oct - refreshing my cache on google every day since 9 Oct.. which is great when you want to make changes to your optimisation and then see the results!
I've had relatively little google bot activity for the past week. This sort of inactivity seems to occur every so often. For the two weeks before google bots were all over my site.
Sometimes, Googlebot sneaks in with sunglasses on so you don't know he's there... I think that's when he spiders those x-rated subdirectories the robots.txt file says to stay away from... Of course, on those days, he doesn't get any real work done...
Mel, you better quit pushing my mules, TOPS30 is a genius even though sometimes he votes against me on the forum He can be stubborn as a mule when he wants to be also. Yea Tops, don't think I don't pick up your comments on the wire about me.... Minstrel, the only answer is that "Google Is Broken"
Pfftttt... Google isn't broken... he's just surfin' the net... chillin'... lookin' for good sites like mine...
I think Compar needs to invite you over for dinner sometime Minstrel, you know you live real close together up there You guys really will do well in the future here I believe since you are both smart operators. You two need to settle this GOO is broke issue so you can be friends, no doubt about it, you are not going to give in anytime soon. It may be a while before the above can play itself out (you and Compar becoming friends), but if he and I have done it, anything is possible.
Where did I vote against you? I've never done that. Better sort out your sources. Yes I'm a genius and yes I'm stubborn (because I'm right mwuahahahahahaaaaaa ).