"SPEED" of Google Crawler (Googlebot)

Discussion in 'Site & Server Administration' started by ariful, Mar 28, 2006.

0
  1. #1
    Hi Friends,

    Can anyone tell me the "SPEED" of Google Crawler (Googlebot).

    Say, If there are 100GB of data then, in how many sec./min./hr. the Googlebot crawl it or index it.

    Thanks and Enjoy.
     
    ariful, Mar 28, 2006 IP
  2. cowren

    cowren Peon

    Messages:
    2
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    hi,

    seems like that nobody knows how fast Googlebot is, but according to google's paper, their target is to re-build all index within one month. if u can estimate the total size of the Internet (no of link + size of each file), then u may estimate the

    you can refer to their paper http://www.seoearnings.com/se/reference

    cowren
     
    cowren, Mar 28, 2006 IP
  3. relixx

    relixx Active Member

    Messages:
    946
    Likes Received:
    54
    Best Answers:
    0
    Trophy Points:
    70
    #3
    Well, the first thing you must take into account is what the least amount of bandwidth between it and the site's server is, as this will throttle the speed at which is can request pages from the website
     
    relixx, Mar 28, 2006 IP