Disclaimer to Mods: This is NOT my product, just a useful tool that I want to share with everyone here. This software is compeltely free and free of adware/spyware. Their is a piece of free software by SOFTplus called GSiteCrawler. It runs on your computer, and spiders your site this way. It is highly powerful, and I highly recomend it. http://www.gsitecrawler.com/ The sitemap XML file it generates can also has sorting features when you open the file in the browser IE sorting by name, last_updated etc. It is a little intense at first, but crawls perfectly. It allows the setup of rules and everything. It also has automatic uploading of the xml file if you wish and/or 'pinging' google to let them know the sitemap has been updated. Check it out!! http://www.gsitecrawler.com/ [/FONT]
Another free resource Google recently came out with is http://www.google.com/webmasters/ It can create sitemaps, submit content to Google, and have other tools.
Always This program is extremly stable IMO too... It has currently been spidering my one site for almost 10 hours now... and still going lol
Just an update, the spider is still running on my site since I last posted, and has currently found 750,000 links, and still running strong. It has also identified 4 bad links :grin: