sitemap for over 10M pages

Discussion in 'Google' started by redtubex, May 9, 2011.

0
  1. #1
    Hello,

    what sitemap tool you would recommend me for site with over 10M pages. I think php generator tool couldn't handle such quantity of pages. Tried to use xml-sitemaps.com tool with correct settings, but it's never ends, getting such errors:

    Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 13681503 bytes) in /home/admin/sites/site.com/generator/pages/class.utils.inc.php(2) : eval()'d code on line 27

    Can somebody share with your experience. Maybe some good python tool are on the net ?

    thanks
     
    redtubex, May 9, 2011 IP
  2. GuidoB

    GuidoB Member

    Messages:
    327
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    38
    #2
    10M pages are a lot !!!!
    I don't have a fast solution for this!
     
    GuidoB, May 9, 2011 IP
  3. webcosmo

    webcosmo Notable Member

    Messages:
    5,840
    Likes Received:
    153
    Best Answers:
    2
    Trophy Points:
    255
    #3
    you have to split them to many different files and link to those files from the main file.
    i haven't seen any automated tool for this though. you might have to build one.
     
    webcosmo, May 9, 2011 IP
  4. Brandon Sheley

    Brandon Sheley Illustrious Member

    Messages:
    9,721
    Likes Received:
    612
    Best Answers:
    2
    Trophy Points:
    420
    #4
    What script are you trying to use, generally you don't want sitemaps over 20,000 url's.
    You should be able to split them up.
     
    Brandon Sheley, May 9, 2011 IP