protecting whole pages of zip files from being downloaded

Discussion in 'HTML & Website Design' started by tastysites, Mar 30, 2010.

  1. #1
    Anyone know a reliable way (aside from a membership site) to prevent a bunch of zip files from being downloaded all at one time off of one of my websites?

    I don't need to protect the files, as they freeware, but I have noticed heavy download activity which leads me to believe that people are using site rippers or download managers and just pulling everything down at once.

    Help appreciated!
     
    tastysites, Mar 30, 2010 IP
  2. krsix

    krsix Peon

    Messages:
    435
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Do you have options +indexes enabled somewhere by any chance?
     
    krsix, Mar 30, 2010 IP
  3. Fastian

    Fastian Peon

    Messages:
    2,085
    Likes Received:
    235
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Can you check your access log and see what kind of site copier is being used ??

    Here are the most popular "site grabbers" that are used to download complete sites:

    RewriteCond %{HTTP_USER_AGENT} ^(eCatch¦(Get¦Super)Bot¦Kapere¦HTTrack¦JOC¦Offline¦UtilMind¦Xaldon) [NC,OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Web.?(Auto¦Cop¦dup¦Fetch¦Filter¦Gather¦Go¦Leach¦Mine¦Mirror¦Pix¦QL¦RACE¦Sauger) [NC,OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Web.?(site.?(eXtractor¦Quester)¦Snake¦ster¦Strip¦Suck¦vac¦walk¦Whacker¦ZIP) [NC,OR] 
    RewriteCond %{HTTP_USER_AGENT} WebCapture [NC,OR] 
    RewriteCond %{HTTP_USER_AGENT} ^DISCo\ Pump [NC,OR] 
    RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [NC,OR] 
    RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [NC,OR] 
    RewriteCond %{HTTP_USER_AGENT} ^NetZIP [NC,OR]
    RewriteRule .* - [F]
    
    Code (markup):
    Use the above code in your .htaccess file it they wouldn't be able to copy your site using any of them.
     
    Fastian, Mar 30, 2010 IP
  4. tastysites

    tastysites Well-Known Member

    Messages:
    961
    Likes Received:
    53
    Best Answers:
    0
    Trophy Points:
    153
    #4
    I do see a few of the grabbers mentioned above ... thanks for the .htaccess idea; I haven't had a problem like this before and hadn't thought about restricting access this way.

    If there are other ways too to prevent folks from wasting my bandwidth I do appreciate more ideas on the topic.

    Thank you krsix and Fastian!
     
    tastysites, Mar 30, 2010 IP
  5. Fastian

    Fastian Peon

    Messages:
    2,085
    Likes Received:
    235
    Best Answers:
    0
    Trophy Points:
    0
    #5
    You welcome :)
    Here is some reading material for you. Block Spambots
     
    Fastian, Apr 1, 2010 IP