Is there a limit to how deep google will index pages?

Discussion in 'Site & Server Administration' started by steve_gts, Dec 18, 2005.

  1. #1
    I've recently totally re-vamped a site. There are several new pages but they are 3 clicks from the home page. Google has re-indexed all the original pages but is still not seeing the new pages. Is this just a matter of time or will it only index to a certain level within a site?

    Thanks
     
    steve_gts, Dec 18, 2005 IP
  2. Marc-O

    Marc-O Guest

    Messages:
    47
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    I'm having similar "problems" with my site too. It has nearly 10,000 pages but they're all three clicks or more away from the home page. I don't know if that's the reason for the fact that so far only 89 pages have been indexed. The website is online since August this year.
     
    Marc-O, Dec 18, 2005 IP
  3. Marc-O

    Marc-O Guest

    Messages:
    47
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Forgot to mention that the problem may also be caused by the ugly url's like this one:
    www. mydomain. com/index.php?termPrefix=Boatrent&regionNm=Europe&destinationId=16&countryNm=France&countryId=26
    The webdesigners are working on rewriting these url's to google-friendly ones. Hope that helps.
     
    Marc-O, Dec 18, 2005 IP
  4. Ajeet

    Ajeet Well-Known Member

    Messages:
    2,511
    Likes Received:
    503
    Best Answers:
    0
    Trophy Points:
    185
    #4
    There used to be this widespread belief that google will not go more than 3-steps away from the index page. "Steps" were loosely defined as "clicks" or "sub-directory" levels etc. I think that contemporary SEOs do not subscribe to that theory at all.

    Still, for a poorly linked site or for a very new site there might be some merit to what you say. It might have to do with Google finding a link to the deep pages in the first place. But, that should just be a matter of time.

    In the case of very big sites, it is not possible to be within 3 "steps" from the home page. So, do not necessarily bother too much about that. A solution to the situation could be getting more links to the home page as well as to inner-pages. You could consider the usual routine of directory submission to make multiple pleas to the search engines to spider your site.

    In the past few months I have noticed that there seems to be a growing selectivity in choosing pages for spidering. But that is not something that time and more links cannot solve.

    Note: Spidering is step one of a long journey. Quality of content will go a long way in some of the further steps.

    Good Luck.
     
    Ajeet, Dec 18, 2005 IP
  5. SEO-MAN

    SEO-MAN Peon

    Messages:
    673
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Anything more then 3 clicks you should create a sitemap.

    Yes G**gle Will Spider the Non SEO Friendly URL but will take a lot longer then if it was SEO Friendly.

    Suggest you make a siteMap and Do Mod_rewrite.

    There are programs you can Use to make a sitemap for that many pages.
     
    SEO-MAN, Dec 18, 2005 IP
  6. Marc-O

    Marc-O Guest

    Messages:
    47
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    There is a sitemap which is already being spidered by google. Strangely though, the url's from there (still ugly ones) are not (yet) being indexed. From the sitemap it takes at least 2 steps to get all pages.

    The mod_rewrite is being implemented these days/weeks but these guys are telling me it takes a lot of time to do so for the entire site.
     
    Marc-O, Dec 18, 2005 IP
  7. SEO-MAN

    SEO-MAN Peon

    Messages:
    673
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Well if your not happy with them send me a message i can get it done alot faster. :)
     
    SEO-MAN, Dec 18, 2005 IP
  8. Marc-O

    Marc-O Guest

    Messages:
    47
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    If the owner of this webcompany wouldn't have been my partner in business (but apparently with a different agenda) I would have left them long time ago.
     
    Marc-O, Dec 18, 2005 IP
  9. steve_gts

    steve_gts Active Member

    Messages:
    1,170
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    80
    #9
    ounds like mine is just a matter of time then, no long urls and the sitemap is on there. I'll just have to wait I guess as its visited by googlebot every couple of days anyway.
     
    steve_gts, Dec 18, 2005 IP
  10. tork

    tork Peon

    Messages:
    309
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Deep linking should help
     
    tork, Dec 18, 2005 IP
  11. SportsOutlaw

    SportsOutlaw Active Member

    Messages:
    952
    Likes Received:
    37
    Best Answers:
    0
    Trophy Points:
    70
    #11
    I have heard, and have no idea if this is true, that how deep google crawls a site depends on pagerank.

    Any truth to that?
     
    SportsOutlaw, Dec 18, 2005 IP
  12. Marc-O

    Marc-O Guest

    Messages:
    47
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Well, my PR is 3. But I guess when G has indexed all my pages (>10,000) and recognizes all my backlinks (approx 200 but only 12 shown) it could be a 5.
     
    Marc-O, Dec 18, 2005 IP