yea, whenever i crawl my site, it takes hours, it took me like 3hours to crawl 7,300 links of my site.
I use inspyder sitemap creator...it's not free but it's simple to use and I've not had any problems from Google.
Does anyone know of a good one for large sites? I have been using XML Sitemap, but it is so slow and doesn't seem to be working well anymore. It just eats up my memory and Bandwidth. I am up for some suggestions, thanks!
Hi Dj, have you tried any one other than WP ones. I'd love to hear any recom'd'tion from you. so let us know if you have tried any one and give it GREEN for others.
You can try A1 Sitemap Generator. If you have a huge website, you may want to read this article. It is however hard to avoid using bandwidth, nothing else you can do but to make sure you never hit the same URL twice. If you have a pure DB generated website (and your website is huge), you may benefit from writing your own script interfacing directly with your database.
I use WonderWebWare. It's free, doesn't put any limitations on the number of pages, crazy easy to use, and works like a charm. Good luck.