Googlebot gone mad : > 1Gb of hits by the googlebot

Discussion in 'Google' started by spidergod, Feb 10, 2010.

  1. #1
    Hello

    Anyone else ever had this :

    Googlebot 3803+9 1.42 GB 10 Feb 2010 - 03:43

    Is this something to be worried about?

    only happened on one site, all the rest are within normal googlebot search pattern/hits.

    thanks
     
    spidergod, Feb 10, 2010 IP
  2. poker princess

    poker princess Member

    Messages:
    171
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #2
    not sure, btw where did you get this figure, let me know so I might learn something new :)
     
    poker princess, Feb 13, 2010 IP
  3. Abhik

    Abhik ..:: The ONE ::..

    Messages:
    11,337
    Likes Received:
    606
    Best Answers:
    0
    Trophy Points:
    410
    Digital Goods:
    2
    #3
    Do you have a huge sitemap? I don't think it's possible with normal googlebot.
    But, if you have lots of images, Googlebot-image may downloaded them all to cache.
     
    Abhik, Feb 13, 2010 IP
  4. Bompa

    Bompa Active Member

    Messages:
    461
    Likes Received:
    20
    Best Answers:
    0
    Trophy Points:
    58
    #4
    If I were you I would immediately check with my host in order to find out
    how much transfer is allowed per month. You might run short and be shut
    down. If you don't have a lot of transfer, put a delay in robots.txt

    Bompa
     
    Bompa, Feb 13, 2010 IP
  5. Earn at Home

    Earn at Home Peon

    Messages:
    240
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    reconfigure your bot visitor time to a week
     
    Earn at Home, Feb 13, 2010 IP
  6. FavouritesBlog

    FavouritesBlog Peon

    Messages:
    846
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #6
    I would be seriously worried if anyone purchased a hosting account with only 2gb of bandwidth.
     
    FavouritesBlog, Feb 14, 2010 IP
  7. duncwilson

    duncwilson Peon

    Messages:
    23
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #7
    If your site is session based & it is showing in URL then google will go crazy
     
    duncwilson, Feb 14, 2010 IP
  8. spidergod

    spidergod Peon

    Messages:
    216
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    the stats were taken from the awstats package on a hostgator account.

    the site is a flash arcade site.

    this strange googlebot behavior has only happened once on this site (site has been up for approx 6 to 7 months).

    very strange
     
    spidergod, Feb 14, 2010 IP
  9. MervinKoops

    MervinKoops Member

    Messages:
    405
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    45
    #9
    Wow that's crazy.

    But if you say it's a flash arcade site, then I suppose it can make sense. If Google has to crawl through all of the pages on a big site like a flash arcade, it seems normal to have used loads of bandwidth.
     
    MervinKoops, Feb 14, 2010 IP
  10. amitash

    amitash Well-Known Member

    Messages:
    399
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    125
    #10
    Nothing to worry about if you are on VPS or dedicated servers. This happens to my site as well.
     
    amitash, Feb 14, 2010 IP
  11. spidergod

    spidergod Peon

    Messages:
    216
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    I have not added any new games to the site for at least 4 months.

    just not sure what is going on
     
    spidergod, Feb 14, 2010 IP
  12. Helado

    Helado Peon

    Messages:
    696
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Um, why? One of my sites had 3360 unique hits in a month and used 62MB bandwidth total... and yes, my site had images. 2GB is ample space, unless you're hosting something big with lots of visitors.
     
    Helado, Feb 14, 2010 IP
  13. amitash

    amitash Well-Known Member

    Messages:
    399
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    125
    #13
    Totally agree. Infact i had a site that has 3000 visits per day and it used to use 50GB per month.. In this case however 2GB wont be sufficient!
     
    amitash, Feb 14, 2010 IP
  14. asterxnu

    asterxnu Peon

    Messages:
    198
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Webmaster tools> change your google bot crawler acces. to something lower.
     
    asterxnu, Feb 14, 2010 IP