Was doing some searching and ran across this site. http://www.wowfilter.info/browse.ph...cnMtYW5kLWJvdHMtaHRhY2Nlc3MtYmFuLWxpc3Q=&b=29 Is it a good idea to add all these? Yes, i'm a clueless noob.
heh...i feel like an idiot now! That's one of the drawbacks of using a proxy on certain sites i guess. http://blog.brontobytes.com/18-spiders-and-bots-htaccess-ban-list
Probably not a good idea to use all of these. Some of them (such as "Java", "Jakarta" and "Python-urllib") could be from legit sites trying to index or check yours.
Unless you're already getting these user-agent strings showing up in your logs, banning them is actually slowing the site down for no reason. Every single request gets ran through that list to see if there's a match. If a page has 10 images on it, that's 11 times the user-agent is being checked for that one page request. Doesn't seem like alot untill you consider 1,000 visitors looking at 5 pages each with 10 images on them equates to 51,000 checks times the 179 user-agents in that list which is 9,129,000 tests being done for those 1,000 requests. That doesn't even take into account things like external stylesheets and scripts. Now, if you're not currently seeing any of those user-agents listed in your log files eating up bandwidth, that means you have 9,129,000 tests being done for no reason. Watch your log files, add measures like that as they're needed.