Anyone know a reliable way (aside from a membership site) to prevent a bunch of zip files from being downloaded all at one time off of one of my websites? I don't need to protect the files, as they freeware, but I have noticed heavy download activity which leads me to believe that people are using site rippers or download managers and just pulling everything down at once. Help appreciated!
Can you check your access log and see what kind of site copier is being used ?? Here are the most popular "site grabbers" that are used to download complete sites: RewriteCond %{HTTP_USER_AGENT} ^(eCatch¦(Get¦Super)Bot¦Kapere¦HTTrack¦JOC¦Offline¦UtilMind¦Xaldon) [NC,OR] RewriteCond %{HTTP_USER_AGENT} ^Web.?(Auto¦Cop¦dup¦Fetch¦Filter¦Gather¦Go¦Leach¦Mine¦Mirror¦Pix¦QL¦RACE¦Sauger) [NC,OR] RewriteCond %{HTTP_USER_AGENT} ^Web.?(site.?(eXtractor¦Quester)¦Snake¦ster¦Strip¦Suck¦vac¦walk¦Whacker¦ZIP) [NC,OR] RewriteCond %{HTTP_USER_AGENT} WebCapture [NC,OR] RewriteCond %{HTTP_USER_AGENT} ^DISCo\ Pump [NC,OR] RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [NC,OR] RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [NC,OR] RewriteCond %{HTTP_USER_AGENT} ^NetZIP [NC,OR] RewriteRule .* - [F] Code (markup): Use the above code in your .htaccess file it they wouldn't be able to copy your site using any of them.
I do see a few of the grabbers mentioned above ... thanks for the .htaccess idea; I haven't had a problem like this before and hadn't thought about restricting access this way. If there are other ways too to prevent folks from wasting my bandwidth I do appreciate more ideas on the topic. Thank you krsix and Fastian!