Hello Everyone, While looking at my logs I find error 404's for bots trying to access robotsxx.txt tiles and other variants. After searching for robotsxx, I thought I would toss this question about there: are these misguided bots or what? Thanks, tom
yes. The only valid name is robots.txt Most robots.txt validators will allow you to validate a file named something else - but only so you can test before you go live.
I've just spotted them on my server - never seen it before today. Any ideas gratefully appreciated... There's some info on the other ones here: http://www.456bereastreet.com/archive/200504/404_oddities/ but little else robotsxx.txt