How to use .htaccess so Google can't index pages ?

Morning All - I have some links to "questionable" pages - they are not paid they are affiliate links - and I would like to disallow google etc from seeing those pages can that be done in .htaccess ?? I don;t want a penalty for linking to a bad neighbourhood thanks

 

Try this page.....

http://www.tw3o.com/robotstxt-guide/

 

Thanks but I want to use .htaccess not the robots.txt

 

Redirect them to 404.

Redirect PERMANENT /somedir/page1.htm http://your.domain/somedir/page2.htm (This will be the 404 page).

 

You really should just use the robots.txt file, its what most search engines use.

 

CAn everyone read the robots txt file ?

 

Yeah, that's the idea. It's just a publicly accessible text file, that has some instructions for robots. A lot of bots will read, and follow it. Of course, you can't force them to. (Although, that doesn't stop people trying. Some websites contain links which are banned in robots.txt, and hidden from the user. Which means, the only people that should be "clicking" it, are from "bad" bots. So they automatically ban the IP address of anything that requests that page)