How do you set a page to "NOT" get indexed by Google

Discussion in 'Google' started by gregdavidson, Jan 13, 2009.

  1. #1
    I was wondering if it was possible to make it to where Google completely ignores certain pages on your site and doesn't crawl them. I'm pretty sure there's a way but I guess I forgot because I've never done it.
     
    gregdavidson, Jan 13, 2009 IP
  2. kelvinblogger

    kelvinblogger Active Member

    Messages:
    328
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    53
    #2
    maby article below can help u.. ;)

     
    kelvinblogger, Jan 13, 2009 IP
  3. jimmy03

    jimmy03 Well-Known Member

    Messages:
    118
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    103
    #3
    It can be done by Disallowing googlebot.
    You can do this by adding "disallow" to Googlebot in robot.txt file of your website.
     
    jimmy03, Jan 13, 2009 IP
  4. Shellerz

    Shellerz Active Member

    Messages:
    1,011
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    78
    #4
    Good advice above - all about the robots text file. Also, If you wanted the page to be indexed but no PR passed to it you could "no follow" any internal links to the page.
     
    Shellerz, Jan 13, 2009 IP
  5. alltheweb1985

    alltheweb1985 Peon

    Messages:
    60
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Agree with the advice above + you can add .htaccess to the pages you don't want to be indexed.

    "nofollow" tag will not prevent google from indexing the page as their may be other dofollow links to that page from other sites.
     
    alltheweb1985, Jan 13, 2009 IP
  6. vishenda

    vishenda Peon

    Messages:
    304
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #6
    very well explained
     
    vishenda, Jan 13, 2009 IP
  7. mytor

    mytor Peon

    Messages:
    80
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #7
    To block a single file being crawled, add the following line to robots.txt:

    Disallow: /subdir/your_file.html
     
    mytor, Jan 13, 2009 IP
  8. freelistfool

    freelistfool Peon

    Messages:
    1,801
    Likes Received:
    101
    Best Answers:
    0
    Trophy Points:
    0
    #8
    You can control it at the page level by putting a meta robots tag with noindex in your page head section. Here's an example that won't index the page or follow any links on the page.

    <meta name="robots" content="noindex,nofollow">
     
    freelistfool, Jan 13, 2009 IP
  9. IEmailer.com

    IEmailer.com Well-Known Member

    Messages:
    1,864
    Likes Received:
    27
    Best Answers:
    0
    Trophy Points:
    110
    #9
    I think that 'kelvinblogger' have answered this question at the top.
     
    IEmailer.com, Jan 13, 2009 IP