External URLS

[lordmenace]

What would I need to add to my robots.txt file to exclude external urls?

[bentong]

if you mean you dont want the bot to follow the link, just add rel="nofollow" on href...

[lordmenace]

if you mean you dont want the bot to follow the link, just add on href...

I have MANY outbound links on my site and I can't add teh nofollow tag to them all. It would take forever. So I figured there might be a way to do it with robots.txt

[Jean-Luc]

robots.txt is for internal URL's only.

Jean-Luc

[rosiee007]

Do you have a dynamic site, or have you given static links from within your website pages to these websites? Are you taking about the links on your link pages or from the web pages?

[lordmenace]

They are static links.

[trichnosis]

add
disallow : /the_external_url_that_you_dont_to_be_indexed.html

if you add this line to your robots.txt , your problem will be solved