Huge Sitemap

Discussion in 'Google Sitemaps' started by a1b2cd4e5, Feb 28, 2009.

0
  1. #1
    Hi,

    I have an Amazon Niche Store that has over a million pages at a guess (Not got time to count :p). Which Sitemap Generator should I use?

    I've tried a few but they just take absolutely ages.
     
    a1b2cd4e5, Feb 28, 2009 IP
  2. michael221

    michael221 Peon

    Messages:
    21
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    I think you can use phpSitemapNG with the "Display edit screen after scan" option disabled and it should do it reasonably quickly.
     
    michael221, Feb 28, 2009 IP
  3. catanich

    catanich Peon

    Messages:
    1,921
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    0
    #3
    We use gSiteCrawler for all of our large sites. But when we get into this size, we will create our own XML Sitemaps (50,000 page limit). Most pages will not change over time and Google doesn't really need a "current" version weekly.

    And no crawler on the market is fast.

    What does Amazon offer to solve this?
     
    catanich, Mar 2, 2009 IP