SEO Experts

Discussion in 'Search Engine Optimization' started by Muhammad Haris, Mar 7, 2007.

0
  1. #1
    My site www.proxybucket.com needs parked domains (mirror domains) for users to access the site at school and other institution because these type of site gets blocked easily.

    I'm conscious that I would get penalized for getting duplicate content and I don' want to do it.

    Is there any way I can block search engine bots from indexing my parked domains through robots.txt

    Note: I parked the domains through cPanel parking option.
     
    Muhammad Haris, Mar 7, 2007 IP
  2. MattUK

    MattUK Notable Member

    Messages:
    6,950
    Likes Received:
    377
    Best Answers:
    0
    Trophy Points:
    275
    #2
    Use this in the robots.txt of the domains you don't want spiders to crawl,

    User-agent: *
    Disallow: /
     
    MattUK, Mar 7, 2007 IP
    Muhammad Haris likes this.
  3. jaguar-archie2006

    jaguar-archie2006 Banned

    Messages:
    631
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #3
    jaguar-archie2006, Mar 7, 2007 IP
    Muhammad Haris likes this.
  4. Muhammad Haris

    Muhammad Haris Peon

    Messages:
    576
    Likes Received:
    34
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Muhammad Haris, Mar 7, 2007 IP