Can I use robots.txt to protect my blog feed?

Discussion in 'robots.txt' started by autorave, Mar 28, 2007.

  1. #1
    Here's the problem ..

    A blogger is scraping my blog feed and putting on his website without attribution. I want to block him from scraping my feed.

    Is there a code I should use to do this? I have his IP Address if that helps.


    Thanks!
     
    autorave, Mar 28, 2007 IP
  2. Monty

    Monty Peon

    Messages:
    1,363
    Likes Received:
    132
    Best Answers:
    0
    Trophy Points:
    0
    #2
    You can't block him with robots.txt because this directives are not mandatory.

    You can block him with .htaccess file with a deny from ip.

     
    Monty, Mar 28, 2007 IP
  3. autorave

    autorave Peon

    Messages:
    995
    Likes Received:
    69
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Thanks Monty.. this is what I am using now:

    But it doesn't seem to work. Is this code correct? Where do I place it in my htaccess file?
     
    autorave, Mar 30, 2007 IP
  4. weppos

    weppos Well-Known Member

    Messages:
    99
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    125
    #4
    You should put it in a parent folder of the file/folder to protect.
    If you upload it into site root it will protect the full site.

    Before uploading the file please check that your webserver is Apache and your hosting provider enabled .htaccess support.
     
    weppos, Apr 16, 2007 IP
  5. kirby009

    kirby009 Peon

    Messages:
    608
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #5
    you can't block that, you can use a blocking tool.
     
    kirby009, Jun 12, 2007 IP
  6. dancom96

    dancom96 Well-Known Member

    Messages:
    1,556
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    105
    #6
    (sorry that my post's off-topic)
    kirby009, did you check the date of the last poster in the thread before you posted? -_-
     
    dancom96, Jul 22, 2007 IP
  7. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #7
    did you tried to block that ip from your cpanel
     
    trichnosis, Aug 6, 2007 IP