Preventing Bad bots (robots)

Discussion in 'robots.txt' started by sck, May 9, 2007.

  1. #1
    Hi all, how can i prevent bad bots or robots that I would not want on the system?

    Please guide me.

    thanks & regards
     
    sck, May 9, 2007 IP
  2. sarahk

    sarahk iTamer Staff

    Messages:
    28,807
    Likes Received:
    4,534
    Best Answers:
    123
    Trophy Points:
    665
    #2
    sarahk, May 9, 2007 IP
  3. T0PS3O

    T0PS3O Feel Good PLC

    Messages:
    13,219
    Likes Received:
    777
    Best Answers:
    0
    Trophy Points:
    0
    #3
    T0PS3O, May 9, 2007 IP
  4. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #4
    you can also use your .htaccess file to prevent spam bots
     
    trichnosis, May 11, 2007 IP
  5. sarahk

    sarahk iTamer Staff

    Messages:
    28,807
    Likes Received:
    4,534
    Best Answers:
    123
    Trophy Points:
    665
    #5
    But only to prevent KNOWN spam bots. They get smarter and so must we - by blocking them early. If you have to research every bot who visits and determine if they are spammy or not then you'll need a full time team working for you.
     
    sarahk, May 12, 2007 IP