Robots file changes

Discussion in 'SEO' started by indunair, Oct 17, 2011.

0
  1. #1
    Hi All,

    I have recently read that "noindex" tag is also accepted in Robots.txt file? Any idea on this?
     
    indunair, Oct 17, 2011 IP
  2. rockymeet

    rockymeet Active Member

    Messages:
    85
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    91
    #2
    simple good robot.txt here

    User-Agent: *
    Disallow: /cgi-bin/

    save in notepad with robot.txt
    no more detail Regarding this

    if you want more then go to Google webmaster and make it according to you
     
    rockymeet, Oct 17, 2011 IP
  3. illianafrazer

    illianafrazer Well-Known Member

    Messages:
    393
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    138
    #3
    Are you trying to ask that

    1.If you can instruct google/ S.E's not to index a particular page/ folder?
    If i am right, yes you can do so.
     
    illianafrazer, Oct 20, 2011 IP
  4. SPA assurance

    SPA assurance Peon

    Messages:
    93
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Thanks for sharing best information about robots.txt file.
     
    SPA assurance, Jan 23, 2012 IP