How to disallow keyword spy

Discussion in 'General Business' started by majestic12, Mar 4, 2009.

0
  1. #1
    majestic12, Mar 4, 2009 IP
  2. jeffh23

    jeffh23 Peon

    Messages:
    50
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    deny their domain in .htaccess

    "deny keywordspy.com"

    However, also deny the ip addresses in your server logs. They could be using addresses outside of their domain to spider from.

    Putting it in robots.txt will do you no good as they ignore it.
     
    jeffh23, Mar 4, 2009 IP
  3. Rocking Designer

    Rocking Designer Banned

    Messages:
    299
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I too view it.
     
    Rocking Designer, Mar 4, 2009 IP
  4. ckweb

    ckweb Well-Known Member

    Messages:
    288
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    105
    #4
    You must be doing something right if you got someone trying to copy you. ;)
     
    ckweb, Mar 4, 2009 IP
  5. majestic12

    majestic12 Peon

    Messages:
    72
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Thanks everyone...

    Never thought of it that way Ckweb Lol..


    Kindest regards David
     
    majestic12, Mar 4, 2009 IP
  6. jeffh23

    jeffh23 Peon

    Messages:
    50
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    While you're at it I'd block spyfu too. They are very similar companies.
     
    jeffh23, Mar 4, 2009 IP
  7. mentos

    mentos Prominent Member

    Messages:
    15,280
    Likes Received:
    473
    Best Answers:
    0
    Trophy Points:
    330
    #7
    There are dozens (perhaps hundreds) of "keyword spy" services out there. There are a wide range of strategies and techniques to identify "bot" activity on your site, including techniques to exclude certain bots.
    Here the steps
    1) Make a backup of your current .htaccess file.

    2) Open the existing .htaccess or create a new one with notepad.

    3) Add the following text on a new line:

    <Limit GET HEAD POST>
    order allow,deny
    deny from 74.53.36.242
    deny from 65.39.72.142
    deny from 66.34.204.26
    deny from 66.34.0.
    deny from 66.34.255.
    deny from keywordspy.com
    deny from keywordspypro.com
    deny from spyfu.com
    deny from spyfoo.com
    deny from foospy.com
    deny from fuspy.com
    allow from all
    </LIMIT>
    RewriteCond %{HTTP_REFERER} keywordspy\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} keywordspypro\.com
    RewriteCond %{HTTP_REFERER} spyfu\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} foospy\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} fuspy\.com [NC,OR]
    RewriteCond %{HTTP_REFERER} spyfoo\.com [NC,OR]
    RewriteRule .* - [F]
     
    mentos, Mar 5, 2009 IP