10,000 Page site

I have used many sitemap generators -- but I have a forum with over 10,000 pages, with threads and other pages. Is there a generator that can put all those pages in the sitemap? in .xml format if possible. Thanks!

 

Did you try xml-sitemaps.com ?

 

will they do that for me? and no lol, i will go there and check it out now, thanks cody +rep for the good information

edit: i just checked -- says "Maximum 500 pages will be indexed in sitemap"

 

Have you tried GsiteCrawler?

 

no, do you have a link for them? well i know you cant put live links but you can put their url as long as you dont have the http part in there to make it active. Thanks!

 

gsitecrawler.com

 

i can also strongly recomend gsitecrawler.com once you have used software to index your site and create a sitemap you have lots of export options for specific search engines such as google yahoo etc.

 

Have you tried this webmaster tool to create your sitemap?

There is no limit on size, it's extremely fast and completely free - most important, it's very easy to use!

 

The best solution I found for me (have a forum too) was to create a simple php script that will generate the sitemap.
It is really very simple to do and shouldn't take more than a few hours of work.
Just make a query to the DB and loop through all the threads in the forum, the benefits are:

1. You'll have total control of the process
2. You might use similar code to do RSS in the future.
3. No capacity on the server for pulling gazillion pages all the time.
4. You can easily tell when the last modification to each page was done, programs that poll your site don't know that.

 

I can make the generator for you if you pay me.

 

Thanks guys. I also have another question. i run www.4design4style.com - which is a directory basically. my question is this, is there a way i can get a sitemap made which will follow all the directory links even though the directory urls are like: http://www.4design4style.com/boutiq...nu=4+visitors&sub3menu=4+last+month&Submit=Go

the only reason i ask is because ive used a couple of the free sitemap generators and none of the directory links appear in the sitemap.

 

If you code the generator yourself, you can do whatever you want.

 

You might also want to try my sitemap generator (see sig)

 

Use SOFTSite GSite Crawler, It was free last time I downloaded it. It takes awhile to crawl. 12 hours.

 

thanks for the tips guys. much appreciated.

 

IPB has free Sitemap generator ..
invisionize.com

 

I prefer phpSitemapNG.

 

try echoxml

 

try http://www.freesitemapgenerator.com/ I have generated a site map bigger than 20 k links with this site. There is a lots of submissions waiting some times and you have to wait couple of days and they state that they have limit like 5k pages but they don't give them a try I believe that they'll be able to generate the site map

 

Try my site - www.makeasitemap.com