Software to create sitemap of 16000 urls

Hi

I have a site with 16000 + urls. I'm curently using software called GsiteCrawler but it takes hours to index the whole site. Does anybody know of a better tool to index and create sitemaps for this many urls?

Thanks

 

Are you running any site or CMS software to manage the site or is it static?

Only one I know of is this but it's still going to take hours to run:

http://www.auditmypc.com/free-sitemap-generator.asp

 

Dreamweaver for design, content on semi static/dynamic pages. Wordpress for blog section of site and phpbb for the forum.

Thats my problem at the moment, time. I've been running my sitemap software all day and it's still not finished. so far it's up to about 18,000 urls.

 

i had the same problem wilst looking there are some paid versions out there... i ended up using the python script from google - do u have ssh access to your server? its easy to use once up there.

 

I'm afriad I don't. I can't afford to use a payed service ethier.

 

What specific software have you tried?

The one I use will do about 5k pages an hour on a static (Movable Type) site with a decent connection. Check for broken links as well since it;s doing it outside of the software.

90% of the pages usually scan quickly. It's the buried ones that take the time.

 

What software is the best? I'll see if I can help in the direction of putting him to the paid software

 

You can try this sitemap generator, but if it's your DB/webserver that is the cause for slowness then... Not much any crawler can do no matter how fast You can also try filter off URLs you don't need/want in the sitemap (e.g. forum profile pages or whatever)

 

I've tried Gsitecrawler (the one i'm using now) and the free google sitemap genorator but that is only limited to 500 URL's. I did try a serverside one, can't remember what it was called but it was rubbish.

I really can't afford to buy a sitemap generator does anybody know if theres a good free one?

 

I linked to one previously:

http://www.auditmypc.com/free-sitemap-generator.asp

 

Its work. easily to use.

 

You could try thesitemapper at http://www.thesitemapper.com

The speed of creating the sitemap does depend on things like internet connection speed, links found per page etc.

 

How quickly you pay them the 30 bucks to buy it....

 

what software have you tried before?

 

I was tried too. And its work easily for me

 

I've been searching the tool,can everyone teel me?

 

Google is also offering this service in webmaster tools.

 

It's better to use some online script, it will be much faster.
I would recommend this one for PHP - enarion.net/google/phpsitemapng/