Hello guys, I've searched thru the forums and Google, but didn''t find a satisfactional answer for my "problem". I have a TGP and all the links are in the same scheme (because of a tradescript). I do want google to spider all the text between the <a ...> TEXT </a> because they are all self-made and unique. However i don't want Google to actually follow these links because it will probably see it as supplemental results then. Is the rel="nofollow" enough for my situation or do i have to take other steps? Thanks in advance. -Raymond
Hello, you use a i frame page and palce mate tag with nofollow noindex in that frame , you may also disfollow in robot.txt.
Yes, content will be indexed but G won't follow the links. Meanwhile, I would recommand to put all the links you don't want G to be indexed into a special directory. This will prevent you to add ever link to the robots.txt Hope this helps. Cheers !
The only links that must be excluded are all internal links and starting with ttt-out.php so i can make a disallow rule based on this file right? User-agent: * Disallow: /ttt-out.php
User-agent: Googlebot Disallow: /*ttt-out.php= that will stop google from following any url that has ttt-out.php.......remember anywhere in the url.....start..middle....or end.. I would be very careful with this...I think its safer to use the nofollow tag
Specifically nofollow tag is More Use full rather than configure at robots.txt because in nofollow tag you can specify what link you don't want to crawl. cheers!