useragents

Discussion in 'Search Engine Optimization' started by darrens, Nov 22, 2007.

  1. #1
    What are the main useragents for the big search engines?
    In otherwords ... if you could only allow a set number of search engines to read your content what would they be ...
    at the moment i have ...

    "msn"
    "mozila"
    "googlebot"
    "Slurp"
    "yahoo"
    "Ask"
    "Jeeves/Teoma"

    am i missing anyone?
     
    darrens, Nov 22, 2007 IP
  2. Dan Schulz

    Dan Schulz Peon

    Messages:
    6,032
    Likes Received:
    437
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Why do you want to restrict user agents?
     
    Dan Schulz, Nov 22, 2007 IP
  3. darrens

    darrens Peon

    Messages:
    808
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #3
    long story ... but i have a new site im ready to launch and i want to try to prevent spiders/bots/scumbags nicking my content so i will try and block them via the useragent.
    I know its not 100% but i simply dont want to block any of the big boys.
     
    darrens, Nov 22, 2007 IP
  4. Dan Schulz

    Dan Schulz Peon

    Messages:
    6,032
    Likes Received:
    437
    Best Answers:
    0
    Trophy Points:
    0
    #4
    It won't work that way. The best defense against scrapers is to identify their hosting providers and send them DMCA takedown notices when they take your content without your permission.
     
    Dan Schulz, Nov 22, 2007 IP