To me it seems google crawls....

Discussion in 'Websites' started by bloodwrath, Jan 18, 2005.

  1. #1
    subdomains more often the subfolters/directories

    example
    my site
    www.supportcave.com gets crawled every 1-2 day
    google cache
    http://64.233.167.104/search?source...0,GGLD:en&q=cache:http://www.supportcave.com/

    subdomain crawled almost same as .com
    http://www.beta.supportcave.com/
    google cache
    http://64.233.167.104/search?source...D:en&q=cache:http://www.beta.supportcave.com/

    my html, php & directroies
    got crawled on the 8th and about every 12 days from google
    http://www.supportcave.com/antivirus-virus-removal-software.html
    http://www.supportcave.com/forum/
    google cache
    http://64.233.167.104/search?source...:en&q=cache:http://www.supportcave.com/forum/

    so from this it would be better to have subdomains then subfolters/directories
    as google get the fresh content faster??

    any ideas
     
    bloodwrath, Jan 18, 2005 IP
  2. T0PS3O

    T0PS3O Feel Good PLC

    Messages:
    13,219
    Likes Received:
    777
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Yes, I have ideas...

    Can't compare it without knowing:

    1) The IBLs to the two domains.
    2) The IBLs to the pages linking to you (Basically PR).
    3) The update frequency of all pages within each domain.
     
    T0PS3O, Jan 18, 2005 IP
  3. bloodwrath

    bloodwrath Active Member

    Messages:
    1,364
    Likes Received:
    49
    Best Answers:
    0
    Trophy Points:
    90
    #3
    1.
    for supportcave.com 188 IBL
    http://www.google.com/search?source...50,GGLD:en&q=link:http://www.supportcave.com/
    beta.supportcave.com 3
    http://www.google.com/search?hl=en&lr=&q=link:http://www.beta.supportcave.com/

    2.
    PR for supportcave.com 3 also in dmoz
    PR for beta.supportcave.com 2 not in dmoz
    PR on site ranegs from 0-4 (0 for the new pages after the PR update

    3.
    google crawls supportcave.com every 1-2 day
    crawls beta site same or so it seems
    crawls entire site every 12 days or so

    does this help and does anyone else notice this
     
    bloodwrath, Jan 18, 2005 IP
  4. bloodwrath

    bloodwrath Active Member

    Messages:
    1,364
    Likes Received:
    49
    Best Answers:
    0
    Trophy Points:
    90
    #4
    hey why was this post moved this was a GOOGLE guestion
    i was not asking help with my site or wanting info on my site

    this was about google and how it works!!! :eek:
     
    bloodwrath, Jan 18, 2005 IP
  5. T0PS3O

    T0PS3O Feel Good PLC

    Messages:
    13,219
    Likes Received:
    777
    Best Answers:
    0
    Trophy Points:
    0
    #5
    And how many IBLs to those 'slow' subfolders?

    My guess is it's down to linking, not the hierarchy.

    And with update frequency I meant content freshness. If your directories are slow moving content-wise, but you update the homepage of the subdomain daily, then you're literally giving Google more food for thought and more reason to drop by.

    It will basically come more often if:

    There's loads of good IBLs coming in.
    There's loads of fresh content appearing frequently.

    And PS: It is about your site really... You found some stats specific to your site and asked whether others see the same on theirs. The answer is probably that it depends on the IBLs and content of your site. That warrants it to go in reviews. But I see the overlapping area...
     
    T0PS3O, Jan 18, 2005 IP
  6. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #6
    Go back and reread your post. It's not about Google (as a company). It's about how to get your site spidered faster BY Google. So the post is about your site.

    The more links you have to a page, the faster it will be crawled. Does not have anything to do with directories, sub-domains, etc.
     
    digitalpoint, Jan 18, 2005 IP
  7. bloodwrath

    bloodwrath Active Member

    Messages:
    1,364
    Likes Received:
    49
    Best Answers:
    0
    Trophy Points:
    90
    #7
    shawn, thanks for the info
    PS why was this moved
    to me this was a google guestion, yes it was specific to my site, but it was about google... and others experiences with google

    just so i know better where to post in the future?
     
    bloodwrath, Jan 18, 2005 IP