Problem getting all pages indexed by Google

Discussion in 'Search Engine Optimization' started by OnInternetBusinessGuide, May 31, 2009.

  1. #1
    One of my websites seems hard to get all of its pages indexed by Google. I see that Google crawls the home page regularly, but many pages do not seem to be indexed. Why? I do not know. The website has been there for a couple of weeks. It looks like Google takes a couple of visits before it indexes the pages. What I find surprising is that it does not index all pages linked from the home page automatically when it visits my website. The pages have real content and they validate properly.

    Should I use the sitemap in the Webmaster Tool to guarantee the indexing?

    Do you know what makes Google so long to index a page when the page is properly linked from the home page?
     
    OnInternetBusinessGuide, May 31, 2009 IP
  2. TheBrainchildGroup

    TheBrainchildGroup Peon

    Messages:
    246
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Generating and submitting a sitemap will surely help this issue. Google needs to understand your site structure in full, then will display all pages and sitelinks.
     
    TheBrainchildGroup, May 31, 2009 IP
  3. onpub

    onpub Peon

    Messages:
    11
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    yes submit by sitemap . your index hit se
     
    onpub, May 31, 2009 IP
  4. jarb

    jarb Peon

    Messages:
    61
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Google will look at every page of your website but they will not necessarily add all of your pages to their search engine. Unique and valuable content tends to get indexed better and faster than generic content. Try adding more substance to your pages....
     
    jarb, Jun 1, 2009 IP
  5. freelistfool

    freelistfool Peon

    Messages:
    1,801
    Likes Received:
    101
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Get some links back to your inner pages. This will help a lot in getting them indexed.
     
    freelistfool, Jun 1, 2009 IP
  6. RightMan

    RightMan Notable Member

    Messages:
    8,294
    Likes Received:
    450
    Best Answers:
    0
    Trophy Points:
    205
    #6
    Adding up too many pages in a very short time could be the problem. Google would take a while to reach your inner pages if they have been added almost simultaneously.

    Regards,

    RightMan
     
    RightMan, Jun 1, 2009 IP
  7. nicholas08

    nicholas08 Peon

    Messages:
    32
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Sitemap will help you for this. Linking from the home page doesn't guarantee that your page will be indexed.
     
    nicholas08, Jun 1, 2009 IP
  8. gusher08

    gusher08 Active Member

    Messages:
    492
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    78
    #8
    add an xml sitemap ang submit it on your google webmaster tools account, also add a sitemap page on your website
     
    gusher08, Jun 2, 2009 IP
  9. bobchrist

    bobchrist Active Member

    Messages:
    4,102
    Likes Received:
    95
    Best Answers:
    0
    Trophy Points:
    88
    #9
    If you've many pages you should add a well structured site map.
     
    bobchrist, Jun 2, 2009 IP
  10. 01c81a0409

    01c81a0409 Peon

    Messages:
    15
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    In general, Google indexes all the pages ASAP.

    If you add many pages at a time, it may some time.

    You can submit your xml sitemap, through WMT to faster index.

    And if you show ur site, it will be good.

    KK
     
    01c81a0409, Jun 2, 2009 IP
  11. rena

    rena Peon

    Messages:
    1,987
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Even add sitemap will take long time to update all pages.. can say upto 12 months....
     
    rena, Jun 2, 2009 IP
  12. Canonical

    Canonical Well-Known Member

    Messages:
    2,223
    Likes Received:
    141
    Best Answers:
    0
    Trophy Points:
    110
    #12
    No matter what you do, there is no way to guarantee that all of your pages will get indexed. And if they are all indexed, there is no way to guarantee that they will remain indexed.

    The most effective way to get all of your pages indexed (if you have a managable number of pages) is to get inbound links to ALL of your pages from other indexed URLs at other sites. This should not only get them indexed but will help keep them indexed (as long as the pages linking to your URL also remain indexed).

    If you have tens of thousands, hundreds of thousands, or millions of URLs on your site, then a sitemap.xml will assist Google in crawling your site and in determining which URLs are most important (i.e. which should be indexed first) using the priorities set in the sitemap.xml. But it's not likely for any site with lots of URLs to every have EVERY URL indexed.

    Ultimately, it depends on whether Google feels it's a good use of the space in their index to allow your URL to get indexed or remain there...
     
    Canonical, Jun 2, 2009 IP