Is Google reluctant to deep crawl new sites lately?

Discussion in 'SEO' started by kentster, Aug 1, 2006.

  1. #1
    I have a domain which I purchased in anticipation of starting a new business in 2004. The domain was previously registered, but based on my research it was a completely legitimate site with no bad practices. Between 2004 - May 2006 I had a temporary 5 page site placed on the domain which Google eventually spidered.
    About 8 weeks ago we placed our new site on the domain, which has about 1000 pages of unique product content. Since then we've added a few more solid backlinks, but Google still has not crawled beyond the index.

    Facts:

    1. Site has good quality 1-way backlinks
    2. Site currently has a PR4
    3. Google has indexed and cached the index page
    4. Index page terms do rank decently for niche phrases
    5. Sitemap submitted and retrieved by Google on numerous occasions
    6. No reciprocal or 3-way link exchanges
    7. Pages are mostly static and there are no session ID issues
    8. Robots.txt is compliant and does not disallow any spiders currently
    9. There are no other mechanisms in place such as .htaccess that could disallow Google in any way

    I'm concerned that there may be an issue at this point. Is Google just slow to index new sites in light of recent problems or do I have a legitimate concern at this point?
     
    kentster, Aug 1, 2006 IP
  2. cldnails

    cldnails Well-Known Member

    Messages:
    1,529
    Likes Received:
    50
    Best Answers:
    0
    Trophy Points:
    120
    #2
    I have noticed the same thing on one of my newer sites. It appears that the bot refuses to go any deeper than the index page for some reason. Lord knows, any guess is as good as the next.
     
    cldnails, Aug 2, 2006 IP
  3. msmp3

    msmp3 Peon

    Messages:
    297
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I also created a new site and google only indexes the first pages (level-1) and doesn't go deeper...
     
    msmp3, Aug 2, 2006 IP
  4. qwestcommunications

    qwestcommunications Notable Member

    Messages:
    8,868
    Likes Received:
    172
    Best Answers:
    0
    Trophy Points:
    233
    #4
    I find that Google does crawl most pages, but sometimes it does not frequent as much as it use to.
     
    qwestcommunications, Aug 2, 2006 IP