1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

How do you create a sitemap if you have thousands of pages in your site?

Discussion in 'Google Sitemaps' started by tyler_durden, Jan 21, 2008.

  1. #1
    I've heard that it's best not to have more than 100 links on a page.
    SEMrush
    So, what if you have thousands or even tens of thousands of pages on your site. Do you break the sitemap down into multiple pages?
     
    tyler_durden, Jan 21, 2008 IP
    SEMrush
  2. vristlefrenk

    vristlefrenk Banned

    Messages:
    90
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #2
    If you have thousand of url than u can use more than one sitemap. You can spit 100 of url per page and make pages as per your need. Suppose u have 10000 url u have to make 100 sitemap page. And give link to next page. Give sitemap2.html page link to sitemap.html and sitemap3.html link in sitemap2.html
     
    vristlefrenk, Jan 21, 2008 IP
  3. websitetools

    websitetools Well-Known Member

    Messages:
    1,508
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #3
    Yeah,check out this HTML Sitemap article which suggests max 100-200 links per page. Google etc. will most likely read more links if your sitemap page has sufficient importance, but in general it will be better to split your HTML sitemaps into more pages (sitemap generator software, e.g. A1SG, can do this for you)
     
    websitetools, Jan 22, 2008 IP
  4. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,927
    Likes Received:
    269
    Best Answers:
    0
    Trophy Points:
    280
    #4
    astup1didiot, Jan 22, 2008 IP
  5. USPB

    USPB Peon

    Messages:
    887
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Google says XML Sitemaps should be no larger than 10MB (10,485,760 bytes) in length when uncompressed and can contain a maximum of 50,000 URLs. This means that if your site contains more than 50,000 URLs or your Sitemap is bigger than 10MB, you must create multiple Sitemap files and use a Sitemap index file. You should use a Sitemap index file even if you have a small site but plan on growing beyond 50,000 URLs or a file size of 10MB.

    Use a software like GSITE Crawler
     
    USPB, Jan 27, 2008 IP
  6. bm66

    bm66 Peon

    Messages:
    17
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    For something like that I use a CMS which is building the sitemap and submits it to google, yahoo and ms live automatically for me everytime the site is updated or at cron time.
     
    bm66, Jan 28, 2008 IP
  7. kavinpparker

    kavinpparker Guest

    Messages:
    81
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Of course, you will have to use more than 1 site map depends on your no. of pages in the site as well as will have to put the link for another site map means Site map_1 has link for Site map_2.
     
    kavinpparker, Feb 4, 2008 IP
  8. fernimac

    fernimac Peon

    Messages:
    3
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    We have generated sitemaps of more than 20 Million pages. Obviously, we had to split them in a lot of smaller XML files and then we have a sitemap index file. And it works!
     
    fernimac, Feb 7, 2008 IP
  9. itsyssolutions

    itsyssolutions Member

    Messages:
    46
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    38
    #9
    I need to create a sitemap for 100 million HTML pages. The site map will be in XML format. What's the best way to go about creating one?
     
    itsyssolutions, May 20, 2009 IP
  10. atkins17

    atkins17 Banned

    Messages:
    153
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Google Sitemaps is an special file that lists all the pages on your site, whether your content has changed, and that you have added a new page. While this is a neat feature, many sites don't need to use it. Keep in mind that Google will find your site and pages by following links.

    See more at http://forums.postpaidseo.com/viewtopic.php?f=4&t=43
     
    atkins17, May 20, 2009 IP
  11. chennai2020

    chennai2020 Banned

    Messages:
    74
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Site maps will not help boost ur page rank or SERP rank. Just it helps google whether to or not to index your page. when there is an option that all your pages get indexed in google then why you wanna restrict with a sitemap?
    Sitemap is not worth
     
    chennai2020, May 21, 2009 IP
  12. mecatrix

    mecatrix Peon

    Messages:
    66
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #12
    i'm having 2k++ sitemaps and it's still doing fine =0
     
    mecatrix, May 21, 2009 IP
  13. redalfa

    redalfa Peon

    Messages:
    96
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #13
    50,000 URLs, how large a database? If you already have such a huge amount of data, the normal operation there should be a very long time! sitemap only to help google index your article, in fact, if the site into the normal track, robots regularly visit the Web site, there is no sitemap can be!
     
    redalfa, May 22, 2009 IP