How to know if the page has noindex in Robot.txt/Meta?

Discussion in 'Search Engine Optimization' started by resaik_king, Apr 19, 2009.

0
  1. #1
    I would like to ask how to know if the page or URL has a noindex tag in robot.txt or in Meta

    I was running a wordpress blog then I would like to add NOINDEX in my TOS, Privacy policy and Contact us page. How can I access meta on Wordpress post? Or i was planning to add robot.txt

    User-agent: *
    Disallow: /contact-us.html
    Disallow: /tos.html
    Disallow: /privacy-policy.html

    Do you think this is a good idea in Robot.txt?
     
    resaik_king, Apr 19, 2009 IP
  2. jitendraag

    jitendraag Notable Member

    Messages:
    3,982
    Likes Received:
    324
    Best Answers:
    1
    Trophy Points:
    270
    #2
    It's fine to have noindex in robots.txt
     
    jitendraag, Apr 20, 2009 IP
    resaik_king likes this.
  3. klatzen

    klatzen Peon

    Messages:
    17
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Yup as he said it's fine
     
    klatzen, Apr 20, 2009 IP
  4. Canonical

    Canonical Well-Known Member

    Messages:
    2,223
    Likes Received:
    141
    Best Answers:
    0
    Trophy Points:
    110
    #4
    Perfectly fine.
     
    Canonical, Apr 20, 2009 IP
  5. kiduka

    kiduka Peon

    Messages:
    419
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #5
    There's nothing wrong with it, if you have a google webmaster tools account you can run a test to check if your robot.txt file is fine.
     
    kiduka, Apr 20, 2009 IP
  6. maxdomain

    maxdomain Peon

    Messages:
    31
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    yes it is fine
     
    maxdomain, Apr 20, 2009 IP