I posted this in search engines but was wondering if anyone here has had become.com tear through there site? I was looking at AWSTATS for my amazon site and it showed me that this host 64.124.85.79.become.com has downloaded 33470 pages from my site and chewed up over 1 gig in bandwidth in the last few days. Is this site worth it or should I block em? AWSTATS did not recognize them as a search engine since there was no hit on robots.txt.
I have had the same problem for the last 4 days. The bot has downloaded143485 times in the past 4 days. Has almost doubled my bandwidth usage. I am wondering the samething myself. Webcowboy
www.stripdir.com is killing my bandwidth. Seems to be a site where the user can download all the images from your pages and browse them, sans ads or whatever. Wonderful.