10 Google Bots at one time?

Discussion in 'Forum Management' started by AliR, Jul 17, 2009.

  1. #1
    I own a forum www.FootballDiscussion.net, i was going through the whos online list, and well, this is what showed up:
    This is the first time this has happened, i browse the online list very often, theres always one Google Bot

    [​IMG]
     
    AliR, Jul 17, 2009 IP
  2. drcsystems

    drcsystems Peon

    Messages:
    123
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #2
    I think every robots came from different google data centers
     
    drcsystems, Jul 17, 2009 IP
  3. bermuda

    bermuda Peon

    Messages:
    868
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Googlebot is generated from tens of data centers and they are regularly crawling the web all the time. No wonder your site has been hit by the bots coming from a variety of IP addresses.
     
    bermuda, Jul 17, 2009 IP
  4. AliR

    AliR Guest

    Messages:
    335
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    So, its good right? ? :p
     
    AliR, Jul 17, 2009 IP
  5. DollarTrader

    DollarTrader Banned

    Messages:
    26
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Dont google bots catch viruses anytime :D ??
     
    DollarTrader, Jul 17, 2009 IP
  6. UnknownOne

    UnknownOne Banned

    Messages:
    466
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #6
    wow 10 at a time...?
     
    UnknownOne, Jul 17, 2009 IP
  7. ascensions

    ascensions Active Member

    Messages:
    175
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    58
    #7
    Ha, one of them likes your forum... they're even posting in it! Time for a robots.txt!
     
    ascensions, Jul 18, 2009 IP
  8. NickR25

    NickR25 Peon

    Messages:
    394
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    0
    #8
    I don't understand the problem. Ten isn't a big number when considering how many crawlers can be on large forums (well, any website for that matter) at a time.

    This is something you should be no less than supportive of. Would you rather have your content crawled at a much lower rate or perhaps not at all? ;)
     
    NickR25, Jul 18, 2009 IP
  9. joebert

    joebert Well-Known Member

    Messages:
    2,150
    Likes Received:
    88
    Best Answers:
    0
    Trophy Points:
    145
    #9
    Don't forget, Google has services like Translate and Adsense which can trigger requests to your server from Google as well.

    For instance look at that screenshot, notice a couple of them are "posting" ?
     
    joebert, Jul 23, 2009 IP