Will google bot crawl nofollow?

Discussion in 'Link Development' started by petr_ind, Jul 16, 2010.

  1. #1
    I want some page of my website is not crawled by google bot.

    Can i use nofollow tag for the link that directed to that page?
    That page i don't want to becrawled is only connected from one page (with nofollow tag).

    or i have to set disallow on the robots.txt?

    thank you :)

    EDIT:
    sorry, i have found the answer from
    http://forums.digitalpoint.com/showthread.php?t=1841012&highlight=crawl+nofollow
    Moderator, you can erase this thread.
     
    petr_ind, Jul 16, 2010 IP
  2. jasonb25

    jasonb25 Member

    Messages:
    968
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    33
    #2
    Both will cover you completely although yahoo will follow your no follow link
     
    jasonb25, Jul 17, 2010 IP
  3. chunnumunnu

    chunnumunnu Active Member

    Messages:
    1,217
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    80
    #3
    prefer not to edit the robots.txt . No follow tag will not pass the PR so its important. Using noindex meta tag in the header of that page will tell all search engines not to index that page. so best way is using nofollow tag as well as noindex metatag.

    if you did anything wrong in robots.txt then it may create trouble for your entire site.
     
    chunnumunnu, Jul 17, 2010 IP
  4. iraqzajil

    iraqzajil Active Member

    Messages:
    64
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    91
    #4
    ""yahoo will follow your no follow link ""
    its first time i hear that
    if you are shore its goooood !
     
    iraqzajil, Jul 17, 2010 IP
  5. webebooks.net

    webebooks.net Peon

    Messages:
    45
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    google bot crawl or not, depend on your robots.txt file.
     
    webebooks.net, Jul 17, 2010 IP
  6. MaxwellSmart

    MaxwellSmart Peon

    Messages:
    107
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #6
    The google bot will follow nofollow links, but not count them in the link popularity/rank of the target page. In order for you to avoid having one of your pages crawled/ indexed at all
    by google or any of the other SE's, you need to specify as much in your robots.txt file.

    Hope that helps!
     
    MaxwellSmart, Jul 17, 2010 IP
  7. websguy

    websguy Member

    Messages:
    63
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    43
    #7
    If your links have some confidential thing and for the security reason you could use robot.text that prevents your website's link indexing in search engine and google crawler skips that link (s).



    ------------------------------------------
     
    websguy, Jul 17, 2010 IP
  8. anilpandeycs

    anilpandeycs Peon

    Messages:
    58
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Google bot will crawl nofollow links but it will not consider into ranking calculations. for example , google webmaster tools shows
    nofollow links from twitter profile page.
     
    anilpandeycs, Jul 19, 2010 IP
  9. M1chael

    M1chael Peon

    Messages:
    110
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Google WILL NOT crawl a no follow page.. BUT! - If someone was to "say..." link to that page, and google followed that link, then it would index that page.

    Regards,
    M1chael
     
    M1chael, Jul 19, 2010 IP
  10. speakeasy602

    speakeasy602 Active Member

    Messages:
    150
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    51
    #10
    Just add the noindex tag in the page header that you don't want to have indexed. It's not rocket science people
     
    speakeasy602, Jul 19, 2010 IP