Help me about Website Copier Programs

Discussion in 'robots.txt' started by yesrams, Oct 28, 2009.

  1. #1
    Hi this is Rams
    I have my own website and some people are trying to copy my website by using WEBSITE COPIER Programs and can you guys please let me know how to protect my website.
     
    yesrams, Oct 28, 2009 IP
  2. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #2
    You can simply check the IP of these web copier programs by checking raw server logs. Once you identify the IPs you can block them using htaccess like

    deny from Blocked IP

    Also, you can block these web copier programs user agent in robots.txt or in htaccess like

    RewriteEngine On
    RewriteCond %{HTTP_USER_AGENT} ^agent name
     
    manish.chauhan, Oct 29, 2009 IP
  3. yesrams

    yesrams Greenhorn

    Messages:
    10
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    11
    #3
    Hi Manish,

    Thankyou very much. It is valuable information for me.


    Thanks alot
     
    yesrams, Oct 29, 2009 IP