I tried by seeing yandex to crawl page, how to stop this?

Discussion in 'All Other Search Engines' started by osmasters, Aug 29, 2009.

  1. #1
    I have some links which has nofollow but yandex crawl is simply crawling and makes my all script to run.

    Please tell me how can i stop this crawling?

    Actually, I am redirecting to other site by link and sending mail but i am geting number of mails because of this yandex crawl.

    I already used below but its not working.

    User-agent: yandex bot
    Disallow: /
     
    osmasters, Aug 29, 2009 IP
  2. searchia

    searchia Well-Known Member

    Messages:
    1,179
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    115
    #2
    searchia, Aug 29, 2009 IP
  3. Luvila

    Luvila Peon

    Messages:
    72
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Luvila, Sep 5, 2009 IP