How often?

Discussion in 'Google' started by syedwasi87, Jul 3, 2007.

0
  1. #1
    How often does google bot crawl here at DP? daily or hourly?

    also does this immedeatly update in the google cache of search results??
     
    syedwasi87, Jul 3, 2007 IP
  2. grg

    grg Guest

    Messages:
    2,692
    Likes Received:
    73
    Best Answers:
    0
    Trophy Points:
    0
    #2
    I think it depends what subpages you talk about - site is very large with many ways to crawl all that.
     
    grg, Jul 3, 2007 IP
  3. syedwasi87

    syedwasi87 Active Member

    Messages:
    2,147
    Likes Received:
    59
    Best Answers:
    0
    Trophy Points:
    90
    #3
    so does it crawl all pages at the same time??

    i mean this forum...?whole of it...
     
    syedwasi87, Jul 3, 2007 IP
  4. cheer

    cheer Peon

    Messages:
    159
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I dont think all pages at same times. Many few pages, there is the possibility.
     
    cheer, Jul 3, 2007 IP
  5. mvandemar

    mvandemar Notable Member

    Messages:
    2,409
    Likes Received:
    307
    Best Answers:
    0
    Trophy Points:
    230
    #5
    I have no clue whatsoever what that bit was supposed to mean.

    Go here to see all of the spiders on the site:

    http://forums.digitalpoint.com/online.php?sort=username&order=asc&pp=200&who=spiders&page=1

    Currently, as I post this, there 867 spiders hitting the site at once. Almost all of them are Yahoo right now, and some MSN. I don't see any Gbots at the moment, although I am sure there are times when it bombards the site spidering pages.

    I'm pretty sure though that Google sucks down more pages per IP than Yahoo does though, so while it might only be showing 1 Gbot to every 20 Yahoo bots, they could still be spidering at the same rate.

    -Michael
     
    mvandemar, Jul 4, 2007 IP