how to ban them sh*tty bots?

Discussion in 'Search Engine Optimization' started by darrens, Jul 9, 2007.

0
  1. #1
    Anyone know how to stop all the crappy bots/spiders using my bandwidth?
    I would like to stop them using .htaccess?
    Anyone have a good list of bad bots they want to share?

    Thanks
     
    darrens, Jul 9, 2007 IP
  2. Nima

    Nima Well-Known Member

    Messages:
    3,489
    Likes Received:
    243
    Best Answers:
    0
    Trophy Points:
    175
    #2
    Why stop them? That means no listing on Search Engines....

    You can slow them down though so they use less bandwidth...

    You can do some of it here: Google Webmaster Tools
     
    Nima, Jul 9, 2007 IP
  3. darrens

    darrens Peon

    Messages:
    808
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #3
    No ... i dont want to stop google/yahoo/msn etc but i want to stop sites like picsearch.com etc .... loads of content pinching bandwidth taking sh*t bag bots
     
    darrens, Jul 9, 2007 IP
  4. w3bmaster

    w3bmaster Notable Member

    Messages:
    17,594
    Likes Received:
    416
    Best Answers:
    1
    Trophy Points:
    240
    #4
    Ban there ip
     
    w3bmaster, Jul 9, 2007 IP
  5. dataneger

    dataneger Peon

    Messages:
    71
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    in the robots.txt disallow bots/spider from those sites by making a useragent rule for the specific robot !!
     
    dataneger, Jul 10, 2007 IP
  6. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #6


    he is talking about unwanted bots. not google;)
     
    trichnosis, Jul 10, 2007 IP
  7. iMarketingGuru

    iMarketingGuru Well-Known Member

    Messages:
    486
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    160
    #7
    iMarketingGuru, Jul 10, 2007 IP