1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Is it necessary to list all pages in a google sitemap?

Discussion in 'Google Sitemaps' started by gary99, Oct 11, 2005.

  1. #1
    Anyone have any opinions about how important it is to list all pages in your google sitemap? Not too painful now, since I don't have many pages, but in the future I can see it becoming more difficult.

    I suppose I could look into the sitemap generator, but that probably wouldn't be too smart about assigning the right priority and changefreq to each page.

    Anyhow I was just wondering if I listed some of the main pages in my site, if the sitemap crawler would be smart enough to crawl pages linked from the main pages, or if it's really important to list them all.
    SEMrush
    Thanks,
    Gary
     
    gary99, Oct 11, 2005 IP
    SEMrush
  2. durango

    durango Guest

    Messages:
    83
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Someone can correct me on this if I'm wrong, but...

    If you want google to know about changes to your pages before its bot comes around to crawl your site, sitemaps is the way to go. It really depends on how fast you want your site to be indexed and for google to see any new pages or changes to existing pages.

    I use it just for the main purpose of making sure google has a good representation of what pages my sites do have. I've seen sites where google crawls every page in the sitemap after I've added a sitemap, and I've seen googlebot simply just grab the sitemap and not crawl the site.

    In conclusion :) I think its safer to go with sitemaps then without, because I don't think it hurts.

    sorry if this confused more than helped.
     
    durango, Oct 11, 2005 IP
  3. gary99

    gary99 Guest

    Messages:
    225
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #3
    No that does help, thanks.

    While I'm asking questions for which probably no one outside of google has answers:

    What about "priority"? Anyone have any inklings on whether that makes any difference? When I created my sitemap I just assumed I should probably assign a higher priority to things like my homepage, and maybe less to pages deep in the site. Anyone have any better ideas?
     
    gary99, Oct 11, 2005 IP
  4. durango

    durango Guest

    Messages:
    83
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Priority will tell Google which of your pages should get higher priority in the crawling queue. Usually your most important page, your home page, would get a priority of 1.0, and then lower that for your internal pages. Go by the importance of the page to yourself in relation to the other pages on your site.
     
    durango, Oct 11, 2005 IP
  5. gary99

    gary99 Guest

    Messages:
    225
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #5
    That's about what I figured, thanks. Another question if I still have your attention:

    What's your experience been with sitemap generation tools? Is the python script google offers any good? (Don't currently have python installed, so I haven't tried it yet). Are there any others out there worth looking at?

    As I said I only have 20 pages or so at this moment, so doing it by hand is not a problem, but I'm afraid of what might happen as things get bigger...

    Thanks again,
    Gary
     
    gary99, Oct 11, 2005 IP
  6. durango

    durango Guest

    Messages:
    83
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #6
    durango, Oct 11, 2005 IP
  7. gary99

    gary99 Guest

    Messages:
    225
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Nifty, thanks for the info.

    -Gary
     
    gary99, Oct 11, 2005 IP
  8. goodfolks

    goodfolks Peon

    Messages:
    134
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #8
    I generally add my newer pages at the top of the sitemap and leave out pages that have already been indexed. Works out best for me.
     
    goodfolks, Oct 12, 2005 IP
  9. catanich

    catanich Peon

    Messages:
    1,921
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Yes the crawler is smart enough to find the other pages. If you do the top 3 levels of a site, Goog will find the fourth level on it's own.

    As for the Site Map priority or change freq, set them to a default setting and don't worry about it. What is important is the last date modified. This is what Goog uses to decide if to index the page or not

    Jim Catanich
     
    catanich, Jul 22, 2006 IP
  10. catanich

    catanich Peon

    Messages:
    1,921
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    0
    #10
    As for site map generator, we have been using the http://gsitecrawler.com/ crawler. It takes some time, but the results will show you where you have broken navigation, link issues, etc.

    And the results have been used by Google, Yahoo, and MSN. There is even formats that have been approved.

    It is also a free tool so check it out.

    Jim Catanich
    http://www.catanich.com/
     
    catanich, Jul 22, 2006 IP
  11. websitetools

    websitetools Well-Known Member

    Messages:
    1,510
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #11
    Well, I have written this article called
    XML Google sitemaps and priority values

    I personally believe, if done right, it is possible to get a slight advantages if using them. Close to minute though, but depends on circumstances.
     
    websitetools, Jul 23, 2006 IP