How to stop a link being spidered?

Discussion in 'Search Engine Optimization' started by misohoni, Sep 22, 2005.

  1. #1
    I remember seeing it somewhere, but forgot the tag. I goes in the <a href tag somewhere and is nofollow="nofollow"?

    Hope you can help
     
    misohoni, Sep 22, 2005 IP
  2. SEbasic

    SEbasic Peon

    Messages:
    6,317
    Likes Received:
    318
    Best Answers:
    0
    Trophy Points:
    0
    #2
    it's

    rel="nofollow"
     
    SEbasic, Sep 22, 2005 IP
  3. Webnauts

    Webnauts Peon

    Messages:
    133
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #3
    <a href="http://www.somewhere.com" title="They way to somewhere" rel="nofollow">
     
    Webnauts, Sep 22, 2005 IP
  4. nohaber

    nohaber Well-Known Member

    Messages:
    276
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    138
    #4
    The rel="nofollow" means "I don't vote for this link" but it won't prevent the crawling/addition of the page.
    The best way to hide a page from Google is to call it as a form. Basically you make a form around the link and the link is a button which you make look like a link with css.
     
    nohaber, Sep 22, 2005 IP
  5. misohoni

    misohoni Notable Member

    Messages:
    1,717
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    200
    #5
    is there another term to use, I don't fancy the form part...
     
    misohoni, Sep 22, 2005 IP
  6. ServerUnion

    ServerUnion Peon

    Messages:
    3,611
    Likes Received:
    296
    Best Answers:
    0
    Trophy Points:
    0
    #6
    ServerUnion, Sep 22, 2005 IP
  7. misohoni

    misohoni Notable Member

    Messages:
    1,717
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    200
    #7
    I should of mentioned about the robots.txt thing. All my links are dynamic and there's about 2k of them, so robots isn't the way to go...looking for a tag to include in the href link part..
     
    misohoni, Sep 22, 2005 IP
  8. Will.Spencer

    Will.Spencer NetBuilder

    Messages:
    14,789
    Likes Received:
    1,040
    Best Answers:
    0
    Trophy Points:
    375
    #8
    Will.Spencer, Sep 22, 2005 IP
  9. nohaber

    nohaber Well-Known Member

    Messages:
    276
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    138
    #9
    My problem with JavaScript links is that too many spammers use them. I don't want to attract attention :)
    The disallowed in robots.txt links are not crawled, but the link and the anchor text may get in the index and participate in rankings (though Google won't show a snippet). I think there's another disadvantage and that is that Google may treat those links as dangling and that may drain PageRank (which in term means you actually vote with your PR power, but it goes to waste and does not go to the final URL, as some websites/directories do)
     
    nohaber, Sep 22, 2005 IP
  10. johnt

    johnt Peon

    Messages:
    178
    Likes Received:
    21
    Best Answers:
    0
    Trophy Points:
    0
    #10
    you could use the robots meta-tag on the target page

    <meta name="robots" content="noindex, noarchive">
    Code (markup):
     
    johnt, Sep 22, 2005 IP
  11. ServerUnion

    ServerUnion Peon

    Messages:
    3,611
    Likes Received:
    296
    Best Answers:
    0
    Trophy Points:
    0
    #11
    was just going at add that remark, beat me to it...
     
    ServerUnion, Sep 22, 2005 IP
  12. nohaber

    nohaber Well-Known Member

    Messages:
    276
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    138
    #12
    It's still a dangling link.
     
    nohaber, Sep 22, 2005 IP
  13. johnt

    johnt Peon

    Messages:
    178
    Likes Received:
    21
    Best Answers:
    0
    Trophy Points:
    0
    #13
    You could combine it with rel=nofollow.

    That way there's no PR passed and the page doesn't get spidered
     
    johnt, Sep 22, 2005 IP