Intense spidering of late? The spidering has been fast, requesting between 2 - 5 pages a second - and on my site, google sets up came and runs around for several hours... What amazes me more, is that ive had 3 such crawls in the last week or so. its like every other day google is all over me like a cheap suit. IM not complaining mind you. IM just pondering what this is indicative of. I thinking I have had a jump in PR that isnt displaying on the toolbar as of yet. Or is it possible, that google has had index troubles of late, which could explain why no pr updates for a long time, and they are now reindexing or confirming a rebuilt index?
yep, others have definitely noticed: http://www.webmasterworld.com/forum3/25897.htm I really have no idea why it would be hitting things so hard globally... maybe something interesting's in the works, though
Yeh Google has been goin hell for leather today! I published four pages this morning and they are in the G index already and kickin arse in the rankings
I ve been having the same thing. I am working on an experiment - I went from non existant for a serch term to #1+2 position in less then a week.....
Damn! http://www.mystockforum.com/ Google bot has been on that site for 8 hours now. What the hell? There is NOT enough on that site to spider for so many hours. Has Google gone mad?
I might be wrong, but I think Google has some new on page factor it is looking for in relation to PR determination, which would explain why no toolbar update for so long. If true - this is prep for a toolbar update.
I believe he means that Googlebot is still active on his sites, which would make it about 12 hours that it has been spidering his site. Must be a very large site.....
That is just it. It is not a large site: http://www.mystockforum.com I wish they would spend that much time on my better sites.
GBot has just left my site - seemed to be a bit quicker than normal. also noticed that i have suddenly jumped for my two main keywords - from 21 to 9 for my uncompetitive one and from 251 to 219 for my more competetive (after both had been pretty stale for about a month and a half- regardless of my best efforts)
Yeah... Brett (Over at WMW) seemed to think that it was panic indexing... Almost like the index had to be rebuilt quickly... Maybe all the latest links are being checked in liu of a PR update... It is due (If what googleguy said is true about quartely updates)
i have a a sneaky feeling we could be about to see a major change of some sort - if it does happen i just hope it's going to treat my site ok.
As I said - I think Google has some new on page factor it is looking for in relation to PR determination, which would explain why no toolbar update for so long. If true - this is prep for a toolbar update. Google has been on my site, Lincoln vs Cadillac Forums and on my Lincoln Mark VIII site consistantly for over a week. There in a fury one day, gone the next, back the next, etc. Deep crawls and crawling fast. Like its not so much looking for content per se, but like its looking for something it hasnt looked for before. Some new element. Maybe reading KW or something
Google Spider still cranking on my site, but been joined by the Yahoo! Slurp Spider and the JetEye Spider - all rapin me at once!
Lots of spidering on my site and 500 or so new pages added to the index that had never been added. Finally!