Does anyone know of a good sitemap generator script? I am looking for something that will read my robots.txt, is cheap (or free) and can handle a site with 1000+ pages. Thanks for you help!
You could try A1 Sitemap Generator, it can also be configured to obey <meta> nofollow and noindex and <a> nofollow
Thanks dairyman. I have been looking for something like this for awhile. I ran a site map with it, it works very well. It didn't obey the robots.txt file though but it be a setting I have to turn on. I will play with it more. Appreciated!
I usually use sitemapdoc.com I find it it quite good and it has a few options that make it easy to use.