1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Google is not indexing all URLs in my site

Discussion in 'Google Sitemaps' started by rizwanrajput, Oct 22, 2009.

  1. #1
    My sitemap contains around 946 Urls, but only 362 of them are indexed in google (according to Google Webmaster Tools).
    SEMrush
    Can anyone tell me what should I do to crawl all 946 Urls in google ?
     
    rizwanrajput, Oct 22, 2009 IP
    SEMrush
  2. alek

    alek Banned

    Messages:
    846
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    58
    #2
    Just wait and nothing.
     
    alek, Oct 22, 2009 IP
  3. rizwanrajput

    rizwanrajput Active Member

    Messages:
    51
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    91
    #3
    dude its been months now
     
    rizwanrajput, Oct 22, 2009 IP
  4. itismine

    itismine Active Member

    Messages:
    489
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    90
    #4
    Wait and see,
    google can take time crawl all pages of any site
     
    itismine, Oct 23, 2009 IP
  5. onsons

    onsons Peon

    Messages:
    108
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    u can break site map in small part of 100 link/ sitemap. sitemap1, sitemap2, sitemap3...................sitemap10
    then in webmaster tool submit all 10 sitemap
     
    onsons, Oct 24, 2009 IP
  6. rizwanrajput

    rizwanrajput Active Member

    Messages:
    51
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    91
    #6
    is it good to make more than 1 sitemap? I heard there should be only 1 sitemap
     
    rizwanrajput, Nov 3, 2009 IP
  7. flypark

    flypark Peon

    Messages:
    166
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Have you actually submitted a site map to google containing all the urls
     
    flypark, Nov 3, 2009 IP
  8. Benii

    Benii Peon

    Messages:
    94
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #8
    they won't index every page. Unless every single page on your site is important (according to google)
     
    Benii, Nov 4, 2009 IP
  9. webrickco

    webrickco Active Member

    Messages:
    268
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    60
    #9
    Making several Sitemap file is only good and is a requisite from google after 50000 URL. with 1000 URL, there's no need to divide.
    There are a certain number of reasons why your URL are not being indexed after a long period of time. Have you check the reasons given in the webmaster area? For example if your URL is giving a redirect return code (0302) when opened, it won't be indexed by Google. Try to generate your sitemap through http://www.webrickco.com/buildsitemap.php, it will give you all return codes for each URL after submission by clicking on a line.
    Relevance is also a factor of indexation. If many of your pages look similar, it won't index them. Based on what criteria? Only they know. I have also not all my pages indexed by google and apparently, there's no obvious reason for that.
     
    webrickco, Nov 5, 2009 IP
  10. maher961

    maher961 Member

    Messages:
    80
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #10
    just wait, google takes time
     
    maher961, Nov 9, 2009 IP
  11. stylight

    stylight Peon

    Messages:
    38
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    As somebody already mentioned here, Google won't index every page. AFAIK Google index all pages directly linked from the home page, while deeper pages are not always indexed. If such pages are linked from external pages, it increases the probability that they will be indexed by Google.

    Cheers,
    Sty
     
    stylight, Nov 9, 2009 IP
  12. kailash

    kailash Well-Known Member

    Messages:
    1,251
    Likes Received:
    42
    Best Answers:
    0
    Trophy Points:
    100
    #12
    It is not really needed until you have more than 50000 URLs. It is not necessary that Google indexes all pages at once. It may take few days or several months.

    Kailash
     
    kailash, Nov 9, 2009 IP
  13. kitakaze99

    kitakaze99 Peon

    Messages:
    27
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #13
    google is not gonna index every page!!! some page link image url ... id no text no information for google....
     
    kitakaze99, Nov 11, 2009 IP
  14. Afqam

    Afqam Greenhorn

    Messages:
    87
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #14
    Check your sitmaps' URLs (spell check) if ok then wait because Google bot have a lot of urls in daily bases.
    its take time
     
    Afqam, Nov 12, 2009 IP
  15. flypark

    flypark Peon

    Messages:
    166
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #15
    Surley if you submit all your urls to google eventually they will all get indexed?
     
    flypark, Nov 13, 2009 IP
  16. rickyponting66

    rickyponting66 Peon

    Messages:
    143
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #16
    depends on the content of the pagE :|
     
    rickyponting66, Nov 13, 2009 IP
  17. dinnyhead

    dinnyhead Peon

    Messages:
    50
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #17
    i think it makes a difference if your site is proceeded with www or not. you might have different urls throughout your site, and google is only picking up one or the other, if that makes sense. eg, you might have a page *ttp://yoursite....., and another *ttp://www.yoursite..... Im not sure exactly what this means, but i think it has an effect on the sites being indexed. trouble is, you have a lot of pages to go through and change, it's probably not worth it.
     
    dinnyhead, Nov 13, 2009 IP
  18. websitetools

    websitetools Well-Known Member

    Messages:
    1,510
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #18
    You should always make sure not to have duplicate URLs. Mixing www with non-www, having port numbers in URLs etc. is all bad. Decide to use one (e.g. non-www or www)

    Beyond that you will need some patience for Google to index all URLs.
    It's also always an advantage if you can get backlinks to your content.
     
    websitetools, Nov 13, 2009 IP
  19. xhanch

    xhanch Member

    Messages:
    683
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    35
    #19
    It takes time...
    It could be your indexes to old articles/contents of your has been cut by google and replaced with your news ones.
    Please consider revising your articles once in a while.
     
    xhanch, Nov 14, 2009 IP
  20. mickeyy

    mickeyy Active Member

    Messages:
    57
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    93
    #20
    Just my two cents...
    Google was indexing my site pretty well until I submitted a sitemap. Then, not only did my indexing stop - also my traffic died off almost completely - all my rankings tanked. No idea why.

    My opinion is that Google can find your pages just fine without a sitemap as long as you have a logical structure to your site. I would build links to your top and sub level categories using social bookmarking etc. Also, on page links (in modules etc) to your lower level categories will help alot.
     
    mickeyy, Dec 5, 2009 IP