1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

How to prevent robots.txt from being indexed?

Discussion in 'robots.txt' started by Devtard, Apr 17, 2013.

  1. #1
    I want Google to be able to access my file robots.txt but I don't want it to be shown in the search search results, check the link below:

    https://www.google.com/search?q=".com/robots.txt"

    Is there a way to do that?
    Will "Disallow: /robots.txt" work?
     
    Solved! View solution.
    Devtard, Apr 17, 2013 IP
  2. Techking

    Techking Well-Known Member

    Messages:
    611
    Likes Received:
    9
    Best Answers:
    1
    Trophy Points:
    130
    #2
    Will "Disallow: /robots.txt" work?

    Try it.It should work !
     
    Techking, Apr 21, 2013 IP
  3. Devtard

    Devtard Notable Member

    Messages:
    850
    Likes Received:
    133
    Best Answers:
    4
    Trophy Points:
    220
    #3
    I don't want to try anything, I need to know whether it works or not. Are you sure or just guessing?
     
    Devtard, Apr 22, 2013 IP
  4. blogdum

    blogdum Well-Known Member

    Messages:
    538
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    100
    #4
    Have you tried this : "Disallow: /robots.txt" ?
     
    blogdum, Apr 25, 2013 IP
  5. Devtard

    Devtard Notable Member

    Messages:
    850
    Likes Received:
    133
    Best Answers:
    4
    Trophy Points:
    220
    #5
    No I haven't. That's why I am asking here if anyone else has.

    My intention is to implement this on a very large website so I need to be sure that it won't cause any harm.
     
    Devtard, Apr 25, 2013 IP
  6. #6
    Last edited: May 3, 2013
    ryan_uk, May 3, 2013 IP
    Arick unirow and Devtard like this.