How To Prevent Indexing of Download Page?

Discussion in 'Google' started by Contenthub, Jun 14, 2007.

  1. #1
    Dear friends,

    How do I prevent Google or any other search engines from spidering my download page? While I only want google to index my content pages, I wouldn't want google to be indexing my download page for my Clickbank product.

    Thanks in advance,
    EL
     
    Contenthub, Jun 14, 2007 IP
  2. xAlexKimx

    xAlexKimx Well-Known Member

    Messages:
    547
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    158
    #2
    You need to have create a robot.txt allow or disallow robot to find that page or folder. upload to your root.

    # robots.txt for http://www.example.com/
    ---------------------

    User-agent: *
    Disallow: /cyberworld/map/ # This is an infinite virtual URL space
    Disallow: /tmp/ # these will soon disappear
    Disallow: /.html

    -----------------
    hope this help..
     
    xAlexKimx, Jun 14, 2007 IP
  3. oseymour

    oseymour Well-Known Member

    Messages:
    3,960
    Likes Received:
    92
    Best Answers:
    0
    Trophy Points:
    135
    #3
    or could add this meta tag to your download page
    <meta name="robots" content="noindex,nofollow">
     
    oseymour, Jun 14, 2007 IP
  4. pk_synths

    pk_synths Peon

    Messages:
    83
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #4
    or use rel=nofollow or Javascript on the link.

    ContentHub, I'd beware of the robots.txt example above because I'm not sure xAlexKimx knows your site's structure. Could really mess indexing up for you. Read up on robots.txt before adding it to your site.
     
    pk_synths, Jun 14, 2007 IP
  5. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #5
    adding those pages to your robots.txt file is the best solution for you;)
     
    trichnosis, Jun 14, 2007 IP
  6. Contenthub

    Contenthub Peon

    Messages:
    47
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Hey guys,

    Thanks for all your suggestions. I will probably try out adding the meta tag, as suggested by seo ranter.

    Really appreciate all your quick responses,
    EL
     
    Contenthub, Jun 14, 2007 IP