How to stop referer and bad pages being indexed

Discussion in 'Site & Server Administration' started by kittyKat, Dec 13, 2008.

  1. #1
    Recently i ran across pages of my website being indexed by someone linking to me. I cant seem to find where its coming from.

    Here is what is happening though. I am getting indexed for pages like this website.com/?referer=sphere_search instead of just website.com

    Does anyone know how I can stop this in my robots.txt or .htaccess? More and more pages are getting indexed. Its causing a duplicate content penalty now and I am seeing my index page disappear sometimes now.

    Thanks
     
    kittyKat, Dec 13, 2008 IP
  2. SSANZ

    SSANZ Peon

    Messages:
    861
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Enable Hotlinking protection?
     
    SSANZ, Dec 14, 2008 IP