Xenu is a link checking tool which I use to check my sites, I've used it for years and like it for it's simplicity and that it's free. I've been going through my Botspotter data trying to identify who might be causing my recent problems. I looked for IP addresses using more than one user agent. I found something interesting. On the Google range of IP addresses there is a stack of hits using Xenu http://home.snafu.de/tilman/xenulink.html, some where they're testing WAP capabilities but Xenu is the only other "crawler" they use. An interesting endorsement for this tool. Sarah
Just to echo Sarah's comment, Xenu ROCKS! Every webmaster should periodically run a link checker - Xenu is highly recommended. alek
Xenu has never been online. however there are scripts to create sitemaps for most, if not all, the content management systems. These use the database to build the sitemaps rather than crawling the site. Xenu crawls the site and crawling is an inefficient way to generate a sitemap.