sarahk
Apr 11th 2004, 3:37 am
Xenu is a link checking tool which I use to check my sites, I've used it for years and like it for it's simplicity and that it's free.
I've been going through my Botspotter data trying to identify who might be causing my recent problems. I looked for IP addresses using more than one user agent.
I found something interesting. On the Google range of IP addresses there is a stack of hits using Xenu http://home.snafu.de/tilman/xenulink.html, some where they're testing WAP capabilities but Xenu is the only other "crawler" they use.
An interesting endorsement for this tool.
Sarah
I've been going through my Botspotter data trying to identify who might be causing my recent problems. I looked for IP addresses using more than one user agent.
I found something interesting. On the Google range of IP addresses there is a stack of hits using Xenu http://home.snafu.de/tilman/xenulink.html, some where they're testing WAP capabilities but Xenu is the only other "crawler" they use.
An interesting endorsement for this tool.
Sarah