Googlebot?

Discussion in 'Google' started by Aneley, Jul 31, 2004.

  1. #1
    OK, this question has probably been answered before and I have tried to find a related topic with no success.. Blame it on only 3 hours of sleep and lack of concentration. :)
    Anyway here it goes, I hope you don't mind. :D
    How often does googlebot crawl a site? Would a number from 10-20x a day be normal activity? I know that it crawls daily to check for page updates, I was just wondering if the frequency here is normal. :)
    Ok, that's all from me, I'm off to sleep. :cool:
    Have a great weekend.
     
    Aneley, Jul 31, 2004 IP
  2. anthonycea

    anthonycea Banned

    Messages:
    13,378
    Likes Received:
    342
    Best Answers:
    0
    Trophy Points:
    0
    #2
    They don't just crawl sites, they move in with some of them, Shawn gave the Googlebots and all of their friends apartments at Digital Point.

    See above where is says "Quick Links", hit that drop down menu, click on Who's Online and you will see all of DP's little friends, they live here most of the time.

    I have asked for a room, but to this day Shawn has not offered me an apartment at DP, so I remain homeless. Just a bit in the outer darkness of Digital Point :mad:
     
    anthonycea, Jul 31, 2004 IP
  3. Will.Spencer

    Will.Spencer NetBuilder

    Messages:
    14,789
    Likes Received:
    1,040
    Best Answers:
    0
    Trophy Points:
    375
    #3
    "Normal" depends upon the number of incoming links to your web site.

    Less PR... less frequent visits.

    Once you hit PR5, Googlebot seems to want to visit daily.
     
    Will.Spencer, Jul 31, 2004 IP
  4. expat

    expat Stranger from a far land

    Messages:
    873
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    0
    #4
    on a mature well positioned site I expect to see all major crawlers once a day directly.

    I expect and see "looks" during the day based on extensive triangular linking thus usually all pages not having "last mod" get sucked in during the day.

    If you use ADS the media bot also drops by every now and then to check if the content targeting needs changing.

    So sometimes it's a massive hit and we see about 20 bot's at the same time other days it's more gradual and spread.

    Hope this helps

    G is presently no fun Y & M react to changes on pages much faster often within 24h
    M
     
    expat, Jul 31, 2004 IP