Links that are not specified on sitemap

Discussion in 'Google Sitemaps' started by cosmocentral, Oct 27, 2007.

Thread Status:
Not open for further replies.
  1. #1
    I have a quite large site. So I didn't specify all the links on the sitemap, rather specified all the important links. Those links contain more link to thousands more pages.
    Do you think Google will index all the pages that are not specified on the sitemap?
    Although Google says sitemap is supplemental to crawlers, I am not sure if having such a sitemap would really help.
     
    cosmocentral, Oct 27, 2007 IP
  2. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #2
    Unless you restrict pages or directories in your robots.txt search engines will crawl your entire site, regardless of a sitemap or not. They'll find every page, trust me. As long as all your pages are some how connected via hyperlinks they will get indexed.

    I'd just create a site wide sitemap of all pages, it is the best thing imo. You can view my Google SiteMap FAQ post I just did in this sub-forum, will give you link to a great sitemap generator I use.

    Good Luck.
     
    astup1didiot, Oct 27, 2007 IP
  3. jdg

    jdg Peon

    Messages:
    46
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #3
    At the very least, include them on a separate page linked from the original sitemap. That way you can ensure they are *all* easily found.
     
    jdg, Oct 27, 2007 IP
  4. cosmocentral

    cosmocentral Banned

    Messages:
    349
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Thanks guys.
     
    cosmocentral, Oct 28, 2007 IP
  5. catanich

    catanich Peon

    Messages:
    1,921
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    0
    #5
    I think it is very important to have all links in the site map. This way there is not question if Google is indexing the page.
     
    catanich, Oct 29, 2007 IP
  6. jim@netseek.net

    jim@netseek.net Peon

    Messages:
    73
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Sitemaps get indexed quicker than natural bot website navigation - I'd put all the links in the sitemap - with the most crucial links at the top end of the file. I had a website containing about 10K+ pages - without a sitemap, google picked up about 400 pages during the course of about 4 months - when I loaded the sitemap - google picked up 8000 pages within 3 months. Big difference in indexing speed - and so this is really the importanc of sitemaps - google ability to index your site quicker.
     
    jim@netseek.net, Oct 29, 2007 IP
  7. Goddess

    Goddess Guest

    Messages:
    10
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Thanks for the tip about putting the most crucial links at the top. Think I'll start doing that with new pages, because I've got a strong suspicious that my regular sitemap doesn't get visited as often as usual since I added the google sitemap and they didn't seem to be picking up the new pages which were being added to the bottom of the list.

     
    Goddess, Oct 30, 2007 IP
  8. cosmocentral

    cosmocentral Banned

    Messages:
    349
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Another question. Does Google and Yahoo uses same sitemap format? I am using a basic XML format.
     
    cosmocentral, Nov 2, 2007 IP
  9. vpguy

    vpguy Guest

    Messages:
    275
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #9
    They do if you follow the protocol specified at http://www.sitemaps.org/protocol.php
     
    vpguy, Nov 2, 2007 IP
Thread Status:
Not open for further replies.