Deep crawl

Discussion in 'Google' started by Lucky Bastard, Jan 24, 2005.

  1. wendydettmer

    wendydettmer Peon

    Messages:
    1,462
    Likes Received:
    70
    Best Answers:
    0
    Trophy Points:
    0
    #21

    well, i can say for my site, that's not the criteria. I have had my site up less then a month, and googlebot has been there about every other day. i have a PR of 0
     
    wendydettmer, Jan 25, 2005 IP
  2. dfsweb

    dfsweb Active Member

    Messages:
    1,587
    Likes Received:
    55
    Best Answers:
    0
    Trophy Points:
    88
    #22
    smindsrt: I believe that answers your question! :) The crawl frequency depends on the IBLs. The "new site" that you are talking about must be linked from a high PR or a frequently crawled site. Even the site that is in my signature is getting crawled everyday although it's only 10 days old. It was being crawled every day since I put the site in the signature. BUT, it is not being deep crawled.

    And, I seriously doubt if your site would be getting deep crawled everyday. GBot would probably only be visiting the home page, which is normal even if you have one good link, like from this forum.

    P.S: Wendy, you are most welcome! :)
     
    dfsweb, Jan 25, 2005 IP
  3. Bernard

    Bernard Well-Known Member

    Messages:
    1,608
    Likes Received:
    107
    Best Answers:
    0
    Trophy Points:
    185
    #23
    dfsweb, I gather you were being facetious, but to clarify, I meant that the initial real PR that every page starts with at the beginning of the calculations will only add a fraction of that initial real PR back to the original 10 pages - ie. a miniscule amount.

    The PR that is being circulated among the original 10 pages (built up thanks to the IBLs) will drop when a portion of it is siphoned off to be circulated among the 50,000 new pages because of the dampening factor.
     
    Bernard, Jan 25, 2005 IP
  4. larysmith711

    larysmith711 Notable Member

    Messages:
    3,374
    Likes Received:
    341
    Best Answers:
    0
    Trophy Points:
    215
    #24
    Therefore just like I said PR is updated continuously.

    You just said it yourself! LOL

    Who said I was getting deep crawled everyday??? I didn't. I said "The hoempage has been crawled everyday."

    But I can also show you other sites of mine that get 75% of it's pages crawled everyday.

    Deep crawls only happen about every three weeks in Google, for your information. :D
     
    larysmith711, Jan 25, 2005 IP
  5. dfsweb

    dfsweb Active Member

    Messages:
    1,587
    Likes Received:
    55
    Best Answers:
    0
    Trophy Points:
    88
    #25
    I said that it seems that you have links from a high PR page. I didn't say that your site has a high PR.

    As far as the argument re whether PR is updated regaularly or not is concerned, I won't discuss this any further as neither of us know for sure how Google really works. It's just my opinion that it's updated every 2-3 months due to the amount of actual calculations involved due to multiple iterations on an index containing a few billion pages. But, you have the right to believe what you do!

    Finally, deep crawls depend on your PR. The higher the PR the more often your site is deep crawled. One of my sites (PR4 on the toolbal) used to get deep crawled every 2-3 days and gets deep crawled every week or so now. The fact that your site is getting deep crawled every three weeks just reiterates the fact that your database PR is still low (or 0). The home page is being crawled every day because of a "deep crawl" on the high PR sites that you have links from. Hope this helps!
     
    dfsweb, Jan 26, 2005 IP
  6. larysmith711

    larysmith711 Notable Member

    Messages:
    3,374
    Likes Received:
    341
    Best Answers:
    0
    Trophy Points:
    215
    #26
    So if YOU say PR is updated every 2-3 months why does a site that is new get crawled everyday? You just said:
    Why else would a site a week old get crawled everyday? Do you think I won the Google you get crawled everyday lottery? NO.... I don't think so.

    Again, it is a continuous update.
     
    larysmith711, Jan 26, 2005 IP
  7. dfsweb

    dfsweb Active Member

    Messages:
    1,587
    Likes Received:
    55
    Best Answers:
    0
    Trophy Points:
    88
    #27
    Your site is new but the BLs that you have are from high PR sites that are being deep crawled everyday. Your home page is crawled everyday as a part of a deep crawl on THEIR sites due to THEIR PR. GBot is only getting to your home page through the BLs on other sites, as opposed to directly visiting your site everyday. I am sure all members here who have had new websites in their signature can confirm this behaviour.

    When a PR update takes place and your site gets a PR, you will start getting deep crawls more often. Google also seems to like fresh content, so if you update your home page on a regular basis, you might see Gbot soon for a deep crawl.
     
    dfsweb, Jan 26, 2005 IP
  8. Patient

    Patient Raider

    Messages:
    336
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    123
    #28
    I used to believe this but now I'm not so sure. It seems to me that G just follows links all day. So the more links to a page the more times it will be visited (though I am not suggesting on a 1 for 1 basis as this would be far too inefficient). One would expect a high PR site to have lots of links but remember PR (toolbar anyway) can be bought!

    As you say none of us can know for sure.

    <edit>PS I also believe that real PR is updated continuously but thats just a gut feeling from my experience.</edit>
     
    Patient, Jan 27, 2005 IP
  9. maniac_dk

    maniac_dk Peon

    Messages:
    6
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #29
    I could not see why Google should give your website at penalty for putting a lot of pages with content on the web. isn´t that was makes Google what it is?
     
    maniac_dk, Jan 27, 2005 IP
  10. wrkalot

    wrkalot Well-Known Member

    Messages:
    285
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    108
    #30
    Monster deep crawl going on here. The biggest one in so far on one of my sites... I smell an update coming "soon"
     
    wrkalot, Jan 27, 2005 IP
  11. dfsweb

    dfsweb Active Member

    Messages:
    1,587
    Likes Received:
    55
    Best Answers:
    0
    Trophy Points:
    88
    #31
    Toolbar PR can be bought without getting links from high PR sites?? Please tell us how!!
     
    dfsweb, Jan 27, 2005 IP
  12. dfsweb

    dfsweb Active Member

    Messages:
    1,587
    Likes Received:
    55
    Best Answers:
    0
    Trophy Points:
    88
    #32
    You are correct IMO. I said the same thing in one of the other threads. They did a PR (database) update around mid November. That update was done on pages cached up to 4 weeks before that update.

    They must be up to something similar now. Lotsa activity now. And the update will take place around mid-Feb (3 months from the last one) but will only affect pages cached up to now (or the next couple of days).
     
    dfsweb, Jan 27, 2005 IP
  13. craige

    craige Peon

    Messages:
    90
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #33
    www.seocompany.ca are predicting that a BL update will be in the next day or two and a toolbar PR update on march 26.
     
    craige, Jan 27, 2005 IP
  14. dfsweb

    dfsweb Active Member

    Messages:
    1,587
    Likes Received:
    55
    Best Answers:
    0
    Trophy Points:
    88
    #34
    Oh, we're predicting .... are we? Well, here's mine!

    Database PR to update around 15th of Feb ..... could be Google's Valenine's day gift to webmasters ........ coupled with big movements in SERPs. A BL update would be needed before the database PR is updated, so an update soon would fit in perfectly in the picture. Toolbar PR to update again by the end of March ...... coupled with no change in SERPs.
     
    dfsweb, Jan 28, 2005 IP