View Full Version : Google bots are sleeping on the job??
gordano
Oct 24th 2006, 6:22 am
I thought that google bots visited, gathered data, and went away in a matter of seconds. But when I look at my webstats the bots seem to have sessions of several hours. ... and I though the bots didn't have enough time to crawl the web.
Seems like some of the google bots (66.249.65.164) are sleeping on the job :D
Has anyone seen anything similar, is this normal for google?
rehash
Oct 24th 2006, 11:47 am
several hours sessions?! you mean..it keeps comming for several hours...it cannot sleep, because the connection timesout in some seconds
gordano
Oct 24th 2006, 12:09 pm
Yes, several hours, then it goes, and comes back. Just checked again, livestats shows it has been there for 47 mins. Seems strange to me, maybe it just likes my website :D
master06
Oct 24th 2006, 5:31 pm
some google bots had been waiting my forums about 2 hours. i think this is normal for me.
Eagle Eyes
Oct 24th 2006, 6:57 pm
Yeah, and for some i just kick them out.
Jocelyn
Oct 24th 2006, 7:16 pm
The bots usually try to avoid overloading your server by chewing the whole site at once. So it takes a few pages and goes by passes until it picked the pages it wanted to refresh/add in the index.
vBulletin® v3.6.8, Copyright ©2000-2008, Jelsoft Enterprises Ltd.