[.htaccess and bad bots list] robots.txt of course not works

Discussion in 'robots.txt' started by Death4you, Mar 22, 2008.

0
  1. #1
    what you doing, when bad robots ignore robots.txt, I using of course .htaccess, but still I have a lot of bots, do you have a some big list with bad robots
     
    Death4you, Mar 22, 2008 IP
  2. aukyo

    aukyo Active Member

    Messages:
    179
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    78
    #2
    Anyone? heh.
     
    aukyo, Mar 25, 2008 IP
  3. Mitchelle Johnson

    Mitchelle Johnson Banned

    Messages:
    153
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #3
    You can ban all identified bad robots from getting into your site by inserting few lines at .ht access
    You can ban such bad bots by two ways
    1. by banning all accesses from a particular site
    2. Banning all accesses that use a specific id to access the server.
     
    Mitchelle Johnson, Mar 27, 2008 IP
  4. everythingisplanned

    everythingisplanned Peon

    Messages:
    365
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #4
    blocked all bad bots
     
    everythingisplanned, Mar 28, 2008 IP
  5. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #5
    manish.chauhan, Apr 6, 2008 IP