Digital Point Forums
Wester Union

Go Back   Digital Point Forums > Design & Development > Site & Server Administration > robots.txt
Reload this Page External URLS
Google Analytics
Log In to view
your analytics
Register FAQ/Rules Search Today's Posts Mark Forums Read

Reply
 
Thread Tools
  #1  
Old Sep 20th 2006, 5:16 pm
lordmenace lordmenace is offline
Twilight Vanquisher
  
Join Date: May 2006
Posts: 541
lordmenace is on a distinguished road
External URLS
What would I need to add to my robots.txt file to exclude external urls?
Reply With Quote
  #2  
Old Sep 22nd 2006, 3:25 am
bentong's Avatar
bentong bentong is offline
Banned
  
Join Date: Apr 2005
Posts: 3,549
bentong has much to be proud ofbentong has much to be proud ofbentong has much to be proud ofbentong has much to be proud ofbentong has much to be proud ofbentong has much to be proud ofbentong has much to be proud ofbentong has much to be proud ofbentong has much to be proud of
if you mean you dont want the bot to follow the link, just add
Quote:
rel="nofollow"
on href...
Reply With Quote
  #3  
Old Sep 24th 2006, 6:35 pm
lordmenace lordmenace is offline
Twilight Vanquisher
  
Join Date: May 2006
Posts: 541
lordmenace is on a distinguished road
Quote:
Originally Posted by bentong View Post
if you mean you dont want the bot to follow the link, just add on href...
I have MANY outbound links on my site and I can't add teh nofollow tag to them all. It would take forever. So I figured there might be a way to do it with robots.txt
Reply With Quote
  #4  
Old Sep 24th 2006, 11:10 pm
Jean-Luc's Avatar
Jean-Luc Jean-Luc is offline
Twilight Vanquisher
Recent Blog: Arfooo et nofollow
  
Join Date: Dec 2005
Location: Brussels, Belgium
Posts: 601
Jean-Luc will become famous soon enough
robots.txt is for internal URL's only.

Jean-Luc
__________________
Regular Expression Tester
Redirect Checker as easy as 1 2 3, even if you are not a HTTP-header guru !
Reply With Quote
  #5  
Old Sep 25th 2006, 12:42 am
rosiee007's Avatar
rosiee007 rosiee007 is offline
Starcaller
Recent Blog: Mobile Marketing can be irritating
  
Join Date: Apr 2006
Location: www.SEO-Reloaded.com
Posts: 3,320
rosiee007 is a splendid one to beholdrosiee007 is a splendid one to beholdrosiee007 is a splendid one to beholdrosiee007 is a splendid one to beholdrosiee007 is a splendid one to beholdrosiee007 is a splendid one to beholdrosiee007 is a splendid one to behold
Do you have a dynamic site, or have you given static links from within your website pages to these websites? Are you taking about the links on your link pages or from the web pages?
Reply With Quote
  #6  
Old Oct 7th 2006, 3:05 am
lordmenace lordmenace is offline
Twilight Vanquisher
  
Join Date: May 2006
Posts: 541
lordmenace is on a distinguished road
They are static links.
Reply With Quote
  #7  
Old Dec 18th 2006, 3:20 pm
trichnosis trichnosis is offline
Herald of the Titans
  
Join Date: Jul 2005
Location: use this space for 15$/month
Posts: 13,721
trichnosis has much to be proud oftrichnosis has much to be proud oftrichnosis has much to be proud oftrichnosis has much to be proud oftrichnosis has much to be proud oftrichnosis has much to be proud oftrichnosis has much to be proud oftrichnosis has much to be proud oftrichnosis has much to be proud oftrichnosis has much to be proud of
add
disallow : /the_external_url_that_you_dont_to_be_indexed.html

if you add this line to your robots.txt , your problem will be solved
__________________
Reply With Quote
Reply

Bookmarks

« Previous Thread | Next Thread »
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
External Nofollow mdvaldosta Link Development 26 Aug 24th 2009 3:44 am
Create short URLs, custom URLs, Safe URLs ans Subdomain Website for sale. czar Sites 12 Jul 31st 2009 10:45 pm
embedded CSS vs External macz_g CSS 3 Sep 7th 2006 8:27 am
How Can I get external links to come up in a new window timothy104 HTML & Website Design 9 Jul 22nd 2006 2:44 pm
External Forms falarious JavaScript 0 May 15th 2006 6:58 pm


All times are GMT -8. The time now is 8:08 pm.

Digital Point Solutions - Library - Top