robots.txt

Discussion in 'Link Development' started by buckknife1, Aug 20, 2008.

  1. #1
    Does a site that has a robots.txt mean that if I comment on the site, my link won't pass pr to my site or count as a web backlink or is there still a benefit? I really don't know what a robots.txt do?
     
    buckknife1, Aug 20, 2008 IP
  2. linkdor

    linkdor Banned

    Messages:
    84
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #2
    robots.txt controls the way how your site is accessed and who accesses it, you can stop SE or visitors etc, look for a how to in google and you'll see how many options you can have in a robots file
     
    linkdor, Aug 21, 2008 IP
  3. Rituja

    Rituja Peon

    Messages:
    539
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #3
    my dear friend.......
    robot.txt is the Google visiting code...........
    when we start seo work that time we have to invite to Google from this code.........
     
    Rituja, Aug 21, 2008 IP
  4. jitendraag

    jitendraag Notable Member

    Messages:
    3,982
    Likes Received:
    324
    Best Answers:
    1
    Trophy Points:
    270
    #4
    The "<meta robots nofollow" and "<a rel nofollow" have created a lot of confusion among some people. Robots.txt is a file that can be used to tell SE spiders and other crawlers to skip crawling / indexing certain parts of your website.

    Ref=nofollow for hyper links is the link that doesn't pass PR. You should read more on http://en.wikipedia.org/wiki/Robots.txt
     
    jitendraag, Aug 21, 2008 IP
    buckknife1 likes this.