Blocking Yahoo Bot to index?

Discussion in 'Yahoo' started by faisal313pk, Jan 4, 2008.

0
  1. #1
    How i can stop yahoo bot not to index my pages?
     
    faisal313pk, Jan 4, 2008 IP
  2. WebGeek182

    WebGeek182 Active Member

    Messages:
    510
    Likes Received:
    28
    Best Answers:
    0
    Trophy Points:
    95
    #2
    Why would you want to do that? You'll lose a lot of traffic.
     
    WebGeek182, Jan 4, 2008 IP
  3. faisal313pk

    faisal313pk Peon

    Messages:
    81
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I have some config files and private directories not to index by any search engine specially yahoo. that's why
     
    faisal313pk, Jan 4, 2008 IP
  4. WebGeek182

    WebGeek182 Active Member

    Messages:
    510
    Likes Received:
    28
    Best Answers:
    0
    Trophy Points:
    95
    #4
    Exclude them in your robots.txt. If they are not following your robots.txt directives, you can block from those directories using your .htaccess. Robots.txt is the recommended method. Also, turn off indexing in your .htaccess so it won't reveal files in each directory.
     
    WebGeek182, Jan 4, 2008 IP
  5. sprabhu

    sprabhu Peon

    Messages:
    586
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #5
    You can block the specific robot through your robots.txt file.
     
    sprabhu, Jan 4, 2008 IP
  6. bermuda

    bermuda Peon

    Messages:
    868
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #6
    You might consider using secure servers, the ones needing log in for this purpose, or create several directories and block them from getting indexed from your homepage Robots file.
     
    bermuda, Jan 4, 2008 IP