Best Sitemap Generator for Large Sites?

Anyone have a recommendation for a Sitemap Generator for sites in the 1M+ range?

 

Bueller?

 

Some suggestions:
http://www.xml-sitemaps.com/standalone-google-sitemap-generator.html
http://www.freesitemapgenerator.com/news-archive.html#2005nov27
http://johannesmueller.com/gs/
http://www.sitemapxml.com/

 

I ve be using http://johannesmueller.com/gs/

Not the fasts but will indexed biggish sites

 

That's what I've been using up until now, but my site is bigger than the database will allow. I have't tried the SQL version, but the GSiteCrawler ran out of database space before I got to 1M pages.

 

Cofee cup google site map generator is a good choice

 

The Coffee Cup one won't crawl sites, though, so any large sites that reply on the dynamic creation of pages won't work w/ that SM generator.

 

Bass, im looking for a similar one too - as of now i think the google python script (https://www.google.com/webmasters/tools/docs/en/sitemap-generator.html) is the best option to handle large sites. But i heard that some errors were reported running it on the live server by some webmaster here on DP - so it may be a risky one.

Please do let me know if you found a better third party software.

 

I'm now using http://gsitecrawler.com - it's been updated to allow for crawling of bigger sites.

Best of luck.

 

I have tried to use google python script before. But I just can't figure out how exactly to run the script.

I mean, what requirements do I need to run it from my server?

 

gsitecrawler is good sitemap maker but i allways prefer the module or component if my cms has

 

I try to use GSiteCrawler

 

Hi see this thread:

http://forums.digitalpoint.com/showthread.php?t=328406

 

Trying GSiteCrawler now - is this really the best tool a site of around 100k pages?

 

I use siteexpert...And I love it. It will crawl the biggest sites so I'm told...crawl mine anyway as the free ones didn't. but i also download my site and had it crawl on my comp...was much faster

 

We developed our own google xml sitemap generator.

Our xml sitemap generator can generate 700,000+ pages [tested on 2 sites].

Let me know if you need any help.

 

Hey Bassman - are you still using GsiteCrawler?

-michael

 

Yeah, I use it for all my sites pretty much - except for sites that have built-in sitemap programs.

 

For larger, dynamic sites?

-mb

 

I've used it for a site with almost 2 million dynamic pages.