How do i prevent downloading my whole site / blocking IP's who try to ?

Discussion in 'Site & Server Administration' started by versus2, Aug 16, 2005.

  1. #1
    I heared once about ways to do it, maybe you could help me with it.
    I want to prevent downloading my site (with offline browsers or bots that collect the info from the pages), Because it's a lot of html pages that can easily be downloaded and changed.
    The way to do it if i remember correctly is to prevent ip's from downloading more than X megs in a certain period of time. If it reaches this amount - which means that it's not logical for a normal user of the site, and the site is actually being downloaded - the ip will be blocked.
    So, is there any script that do it or any other method ?

    Thanks,
    E-A.
     
    versus2, Aug 16, 2005 IP
  2. dzcap

    dzcap Well-Known Member

    Messages:
    970
    Likes Received:
    41
    Best Answers:
    0
    Trophy Points:
    153
    #2
    Is there really a need to prevent offline browsing? If someone really wants to scrap your content, they will find some other way to beat your protection. I am not 100% sure but won't you be blocking spiders also if you implement this?
     
    dzcap, Aug 16, 2005 IP
  3. yfs1

    yfs1 User Title Not Found

    Messages:
    13,798
    Likes Received:
    922
    Best Answers:
    0
    Trophy Points:
    0
    #3
    You are playing with fire when using an automated system like this. Wouldn't a better solution be to get a notification and then decide whether to ban the ip?

    There are legitimate reasons that both bots and visitors may be using a lot of bandwidth. An automatic ban will create problems for your good users while the ones scraping will get around it
     
    yfs1, Aug 16, 2005 IP
  4. versus2

    versus2 Well-Known Member

    Messages:
    796
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    110
    #4
    Hmm.. I see. Yes, You're right about it.
    yfs1 - How can i get such a notification ?
     
    versus2, Aug 16, 2005 IP