A few months back, Google actually crashed my site! Yes it single handedly stopped my forum in it's tracks. The bot was crawling my site so much, I felt it was making love with it. I'd sit there just watching my live logs, he'd be crawling everywhere on my site, I felt kind of left out just watching them. Love triangle I wish, the most I could do was site back and video it. (well camtasia it....) He definetly meant business, and my site simply wasn't resisting. Then it went to far and he actually crashed my site! Yup used and abused...left my her completely down. My entire site crashed, as my DB was setup to only receive 50,000 queries in an hour, but ofcourse the bot kept wanting more and more.. Since this I've had to alter things to limit only singular users to query amounts, well thats what my host told me anyway. I was shocked, a bit of google lovin & attention, which we all work so hard to get had backfired. So now things are all fixed, and my sites no longer the new kid on the block, should I take the restriction of their love & look at increasing my # of queries google is allowed on her? Can she handle it...
Hi Matt, It is rather simple to solve... try reading this page.. http://www.google.com/support/webmasters/bin/answer.py?answer=48618&hl=en Allan
yeh found that a few weeks ago. I reackon she can handle the rough stuff now, from a webmaster/parenting point of view, anyone else ever had limits set on a mysql?
I run my forums on a dedicated. We had 10,777 page requests from google in 1 day. Check the owners of this sites webmasters crawl rate from google : http-//www.shawnhogan.com/2006/10/google-crawl-rate.html He got 71,766 pages in 1 day, almost 1 page a second. (okay, avgerage queries on VB 9, x 71,766 = OMFG 645,894 queries!!!!) I can't wait for it to let me select the "faster" option. I wonder if he set faster option for googlebot? Pierce
Hey man! Put online your site, review your PHP code for the mysql queries and recieve all the visitors from google!