robots.txt not being followed?

Discussion in 'Co-op Advertising Network' started by CompressedAir, Nov 11, 2006.

  1. #1
    Hey,
    I've been using coop for a while, but recently my site failed validation on a page I use to explicitly block bad robots not adhering to robots.txt, which subsequently blocked the coop bot :(. AFAIK, something like this has never happened before as the coop bot has always listened to robots.txt. Any advice?
     
    CompressedAir, Nov 11, 2006 IP
  2. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #2
    What's the URL of the page?
     
    digitalpoint, Nov 11, 2006 IP
  3. CompressedAir

    CompressedAir Peon

    Messages:
    56
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    CompressedAir, Nov 11, 2006 IP
  4. fryman

    fryman Kiss my rep

    Messages:
    9,604
    Likes Received:
    777
    Best Answers:
    0
    Trophy Points:
    370
    #4
    How recently?
    The page isn't indexed at google any more so give it another try, should validate now
     
    fryman, Nov 11, 2006 IP
  5. CompressedAir

    CompressedAir Peon

    Messages:
    56
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Hmm..well I just tried it again now. manually, and it still says "Ads not found on http://www.doomedbugs.com/getout.php" :(
     
    CompressedAir, Nov 12, 2006 IP