1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Leaching

Discussion in 'robots.txt' started by Teepeg, Mar 8, 2011.

  1. #1
    Would a robot.txt help with the stopping of leaching?
     
    Teepeg, Mar 8, 2011 IP
  2. carleisenstein

    carleisenstein Peon

    Messages:
    253
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Nope. Following the robots.txt file is optional for a spider. So if someone's automatially stealing content, their robot almost definitely won't read your robots.txt.
     
    carleisenstein, Mar 8, 2011 IP
  3. Teepeg

    Teepeg Member

    Messages:
    45
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #3
    Thanks for response ... Learnt since that it needs to be in the .htaccess file. Now i just need to learn what goes into it!!
     
    Last edited: Mar 8, 2011
    Teepeg, Mar 8, 2011 IP
  4. ACME Squares

    ACME Squares Peon

    Messages:
    98
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Try something like:

    order allow,deny
    deny from [leacher1 IP address]
    deny from [leacher2 IP address]
    allow from all
     
    ACME Squares, Mar 9, 2011 IP