How to prevent robots.txt from being indexed?

Discussion in 'robots.txt' started by Devtard, Apr 17, 2013.

0
  1. #1
    I want Google to be able to access my file robots.txt but I don't want it to be shown in the search search results, check the link below:

    https://www.google.com/search?q=".com/robots.txt"

    Is there a way to do that?
    Will "Disallow: /robots.txt" work?
     
    Solved! View solution.
    Devtard, Apr 17, 2013 IP
  2. Techking

    Techking Well-Known Member

    Messages:
    611
    Likes Received:
    9
    Best Answers:
    1
    Trophy Points:
    130
    #2
    Will "Disallow: /robots.txt" work?

    Try it.It should work !
     
    Techking, Apr 21, 2013 IP
  3. Devtard

    Devtard Notable Member

    Messages:
    850
    Likes Received:
    133
    Best Answers:
    4
    Trophy Points:
    220
    #3
    I don't want to try anything, I need to know whether it works or not. Are you sure or just guessing?
     
    Devtard, Apr 22, 2013 IP
  4. blogdum

    blogdum Well-Known Member

    Messages:
    538
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    100
    #4
    Have you tried this : "Disallow: /robots.txt" ?
     
    blogdum, Apr 25, 2013 IP
  5. Devtard

    Devtard Notable Member

    Messages:
    850
    Likes Received:
    133
    Best Answers:
    4
    Trophy Points:
    220
    #5
    No I haven't. That's why I am asking here if anyone else has.

    My intention is to implement this on a very large website so I need to be sure that it won't cause any harm.
     
    Devtard, Apr 25, 2013 IP
  6. #6
    Last edited: May 3, 2013
    ryan_uk, May 3, 2013 IP
    Arick unirow and Devtard like this.