Googlebot question

Discussion in 'Site & Server Administration' started by rlynch, Feb 24, 2006.

  1. #1
    when googlebot first comes to my site...it goes to a page deep in a folder

    ie. www.domain.com/sub/sub/blah.html

    instead of visiting the homepage

    why is that?
     
    rlynch, Feb 24, 2006 IP
  2. Smyrl

    Smyrl Tomato Republic Staff

    Messages:
    13,740
    Likes Received:
    1,702
    Best Answers:
    78
    Trophy Points:
    510
    #2
    Wonder if you have a link from another site to that page?
     
    Smyrl, Feb 24, 2006 IP
  3. hans

    hans Well-Known Member

    Messages:
    2,923
    Likes Received:
    126
    Best Answers:
    1
    Trophy Points:
    173
    #3
    Googlebot always goes directly to pages never to domain-root to start a visit - except when G wants to visit just your stat page

    hence whatever the cycle to revisit is at G they have a set of pages to visit for each run - on a site with frequent fresh content the number of Gbot visits per months may be several times the nr of pages your site has

    the time when bots started at / then crawled all site hundreds or thousands of pages at once are long time past
     
    hans, Feb 25, 2006 IP