Yahoo Ignoring robots.txt

Discussion in 'robots.txt' started by Notorious, Aug 21, 2006.

0
  1. #1
    Notorious, Aug 21, 2006 IP
  2. Andrey Markin

    Andrey Markin Peon

    Messages:
    39
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Andrey Markin, Aug 22, 2006 IP
  3. Can

    Can Peon

    Messages:
    54
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    for disallowing any page, just hide it - also known as 'cloaking'
     
    Can, Aug 22, 2006 IP
  4. Andrey Markin

    Andrey Markin Peon

    Messages:
    39
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Yep, and get penalized by SE! :confused:
     
    Andrey Markin, Aug 22, 2006 IP