Is there anyone bothered by this bot "FAST MetaWeb Crawler?" It has been downloading my pages every 1-3 minutes for more than one day. What is it doing? I wonder if you have any good solution to prevent it. I have tried banning its IP and robots.txt. But both are useless. It is still downloading my pages and consuming my bandwidth.
I dont think it's a virus. I think its a stupid webbot or something. I don't know. It's leeching from my sites too, it's indeed very annoying.