How To Get Google To Index All The Pages Of A Website

Discussion in 'Search Engine Optimization' started by jvfconsulting, Jan 26, 2011.

  1. #1
    We just launched a new website for a client who is very picky about how fast their new site needs to be indexed in the Google serps. Their website has over 9000 landing pages, all of which have been included in their sitemap.xml and html site structure. Using Google webmaster tools we can see that after 1 week only 1500 of the 9000 pages are indexed. Is there a way to speed this process up? The site already has a bunch of backlinks, and is gaining traffic fast, but Google is dragging its feet and not indexing everything. Any tips you have for us would be great!
     
    jvfconsulting, Jan 26, 2011 IP
  2. abelchua

    abelchua Peon

    Messages:
    175
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Sometimes we can't determine what google decides due to its algorithm. However, we only can try to make sure it indexes everything by doing page SEO. It is very tedious and not recommended. If your client is so particular about that i guess you have to SEO every page and change their meta tags while creating new, keyword dense, quality content. Build backlinks to the main pages of the not indexed pages would speed up the process as well. Hope this helps :)
     
    abelchua, Jan 26, 2011 IP
  3. Tamcake

    Tamcake Active Member

    Messages:
    303
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    65
    #3
    Maybe try submitting a sitemap?

    Try generating a sitemap page and placing it in your footer.
     
    Tamcake, Jan 26, 2011 IP
  4. myseopandit

    myseopandit Peon

    Messages:
    22
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    10 ways to increase pages increased:
    1.page rank.
    2.links.
    3.site maps.
    4.Google's crawl caching proxy .
    5.speed.
    6.Staggered launch.
    7.verify.
    8.content.
    9.Know how your site is found, and tell Google
    10.size matters.
     
    myseopandit, Jan 26, 2011 IP
  5. iccadubai

    iccadubai Peon

    Messages:
    370
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    can you share clear info.
     
    iccadubai, Jan 26, 2011 IP
  6. ameerulislam10

    ameerulislam10 Peon

    Messages:
    461
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #6
    You can set increase crawling rate from Google's webmaster tool.
     
    ameerulislam10, Jan 26, 2011 IP
  7. rajwebwiz

    rajwebwiz Peon

    Messages:
    102
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    9. Know how your site is found?

    bookmarking each page
    drop pages link in digg comments
    delicious
    get google notice your bookmarks pinging
    links from blogspot gets quickly crawled
     
    rajwebwiz, Jan 27, 2011 IP
  8. syanide

    syanide Active Member

    Messages:
    122
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    68
    #8
    Pinging each page is probably your best bet...
     
    syanide, Jan 27, 2011 IP
  9. Ledlauzis

    Ledlauzis Member

    Messages:
    411
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    35
    #9
    To speed things up you need to have some really quality backlinks no forum spam or blog comments, but some real thing.

    And for the website itself you need good interlinking (categories, archive, classification or whatever)
     
    Ledlauzis, Jan 27, 2011 IP
  10. jvfconsulting

    jvfconsulting Active Member

    Messages:
    1,089
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    90
    #10
    We actually have two sitemaps, one /sitemap.xml, and another .html sitemap which is located in the footer
     
    jvfconsulting, Jan 28, 2011 IP
  11. jvfconsulting

    jvfconsulting Active Member

    Messages:
    1,089
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    90
    #11
    Great idea! Let me check to see what its set at right now. errr, I actually don't see a place to throttle the crawl rate! What page is that done on?
     
    jvfconsulting, Jan 28, 2011 IP
  12. jvfconsulting

    jvfconsulting Active Member

    Messages:
    1,089
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    90
    #12
    Thats a great idea. What pinging service do you recommend? There are soo many out there now!
     
    jvfconsulting, Jan 28, 2011 IP
  13. Amy Garrizon

    Amy Garrizon Peon

    Messages:
    300
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Pingomatic is the service most people use and it's very good.
    You can also try tweeting those pages that are not indexed. Tweeting seems to work for me and I get indexed fast usually in that same day.
     
    Amy Garrizon, Jan 28, 2011 IP
  14. brisbane synthetic grass

    brisbane synthetic grass Peon

    Messages:
    22
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #14
    create offsite links to pages that are not being indexed
     
  15. Frost1

    Frost1 Well-Known Member

    Messages:
    519
    Likes Received:
    23
    Best Answers:
    7
    Trophy Points:
    165
    #15
    Create a site map and submit it to Google using Google Webmaster Tools.

    That's the best way to get most of the pages from your website indexed fast on Google, ;)
     
    Frost1, Jan 28, 2011 IP
  16. mikek999

    mikek999 Peon

    Messages:
    11
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #16
    How do you get google to ping a web page?
     
    mikek999, Jan 30, 2011 IP
  17. altertix

    altertix Greenhorn

    Messages:
    39
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #17
    I agree with the fact that pinging each page should helps you to get more pages indexed. Moreover you can try to get backlinks for each page you want to be indexed. It really takes a long time but it works.
     
    altertix, Jan 30, 2011 IP
  18. oseymour

    oseymour Well-Known Member

    Messages:
    3,960
    Likes Received:
    92
    Best Answers:
    0
    Trophy Points:
    135
    #18
    If you are launching a site with 9000 pages at once, I hope its all unique content or don't expect all the pages to be indexed or ranked.

    With that many pages, if they are categorized correctly get deep links to the sub category pages. Get the best links you can, I'm not talking about forum or blog commenting links. Google will take its sweet time and index the pages it wants but deeps links help tell it the pages are important.
     
    oseymour, Jan 30, 2011 IP
  19. Mackster2

    Mackster2 Guest

    Messages:
    29
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #19
    Another apparent way that helps A LITTLE to get them indexed faster is if these pages get many bookmarks from users. How to get users to bookmark your pages is the hard part.
    "add to favorites" auto command on each page.
     
    Last edited: Jan 30, 2011
    Mackster2, Jan 30, 2011 IP
  20. jvfconsulting

    jvfconsulting Active Member

    Messages:
    1,089
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    90
    #20
    Good call! We just added the "add this" widget to each page to promote social networking.
     
    jvfconsulting, Jan 31, 2011 IP