Leaching

Discussion in 'robots.txt' started by Teepeg, Mar 8, 2011.

0
  1. #1
    Would a robot.txt help with the stopping of leaching?
     
    Teepeg, Mar 8, 2011 IP
  2. carleisenstein

    carleisenstein Peon

    Messages:
    253
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Nope. Following the robots.txt file is optional for a spider. So if someone's automatially stealing content, their robot almost definitely won't read your robots.txt.
     
    carleisenstein, Mar 8, 2011 IP
  3. Teepeg

    Teepeg Member

    Messages:
    45
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #3
    Thanks for response ... Learnt since that it needs to be in the .htaccess file. Now i just need to learn what goes into it!!
     
    Last edited: Mar 8, 2011
    Teepeg, Mar 8, 2011 IP
  4. ACME Squares

    ACME Squares Peon

    Messages:
    98
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Try something like:

    order allow,deny
    deny from [leacher1 IP address]
    deny from [leacher2 IP address]
    allow from all
     
    ACME Squares, Mar 9, 2011 IP