Google only indexing 1 out of 190 URL's in my sitemap

Discussion in 'Search Engine Optimization' started by tlshaheen, Mar 22, 2010.

  1. #1
    I have a XML sitemap submitted to Google 5 days ago, and Google is only indexing 1 out of the 190 submitted. It is only indexing my homepage. Why! Most of the 190 pages are articles, and I need Google to index them so they appear on the search engine as well as so I can use Google Custom Search for my site! Anyone have any ideas?
     
    tlshaheen, Mar 22, 2010 IP
  2. Sxperm

    Sxperm Notable Member

    Messages:
    4,386
    Likes Received:
    142
    Best Answers:
    0
    Trophy Points:
    225
    #2
    1. Please check to make sure your sitemap.xml file is not a defect one and all urls are existed and can be crawled

    2. How long did you submit? Google bots has to take around 10 - 14 days before it could recognize a sitemap and crawl / cache them all. This would be especially if your site is new.

    3. Make sure your homepage navigation is properly too.
     
    Sxperm, Mar 22, 2010 IP
  3. tlshaheen

    tlshaheen Peon

    Messages:
    89
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Thank you for your response!
    -I generated the sitemap using http://www.xml-sitemaps.com/ , so it is a valid sitemap

    -I submitted it 5 days ago, and my site is 5 days old, so yes it is still new

    -My navigation is correct

    So I suppose I need to just wait for them all to be crawled?
     
    tlshaheen, Mar 23, 2010 IP
  4. sevnrock

    sevnrock Peon

    Messages:
    241
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Yes, you need to wait. You can't expect a brand new site to be fully crawled and indexed.

    However, 190 articles in 5 days seems rather unrealistic. If Google has crawled a few articles and found that they are duplicate content, Google is less likely to finish crawling your site.
     
    sevnrock, Mar 23, 2010 IP
  5. tlshaheen

    tlshaheen Peon

    Messages:
    89
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    The articles (The articles number around 125 or so) were not all written in 5 days. They were written in the weeks beforehand, I only submitted the site to Google when we opened the site, which was 5 days ago. None of the articles are duplicate - that is, there are 125 articles each about a different person/place/thing.
     
    tlshaheen, Mar 23, 2010 IP
  6. sherone

    sherone Well-Known Member

    Messages:
    1,539
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    130
    #6
    If your site is new one. Google will index the home page for some time. So please wait for few weeks. While you can submit sitemap.xml and robots.txt etc.
     
    sherone, Mar 23, 2010 IP
  7. 1SEONewby

    1SEONewby Peon

    Messages:
    170
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #7
    You most likely know this ,but you can see when and what Google crawled by using the Hub Spot Website Grader. I really love this tool.
     
    1SEONewby, Mar 23, 2010 IP
  8. ontheroad

    ontheroad Greenhorn

    Messages:
    88
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #8
    Please post your URL so I can look further into your site.
     
    ontheroad, Mar 23, 2010 IP
  9. tlshaheen

    tlshaheen Peon

    Messages:
    89
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Thanks for the assistance guys.
    In addition, the site will be provided 2-3 new articles per day. Do I need to re-generate and re-submit a new XML sitemap every night to Google, or will Google eventually catch on and crawl my site more and more often
     
    tlshaheen, Mar 23, 2010 IP
  10. zk5182

    zk5182 Active Member

    Messages:
    896
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    58
    #10
    you ll need to wait for a new site to be indexed
     
    zk5182, Mar 23, 2010 IP
  11. james.parker

    james.parker Peon

    Messages:
    631
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #11
    I think if you have submitted the XML sitemap of the website to the Google search engine then check out the current status of the xml sitemap there. I think there will some problems in the URLs of the website. Please resubmit again the sitemap.
     
    james.parker, Mar 30, 2010 IP