What is Robot.txt File?

Discussion in 'robots.txt' started by gagan.kr90, Apr 25, 2011.

0
  1. #1
    What is Robot.txt File? & Why we use this on our websites?

    Let me know friends, how could this will be beneficial for website?

    Thanks!!
     
    gagan.kr90, Apr 25, 2011 IP
  2. hostingfarms

    hostingfarms Peon

    Messages:
    27
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    robot.txt is a txt file that contains instructions in a specific format .. That often used by robots of search engines to categories and archive web sites ... if this robot.txt file doesn't exist then it means owner doesn't want to provide specific instruction .
     
    hostingfarms, Apr 26, 2011 IP
  3. brainmasterinfo

    brainmasterinfo Member

    Messages:
    177
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    48
    #3
    These are programs which traverse through the Web automatically. Search engines likr yahoo, Google use them to index the web content, spammers use them to scan for email addresses, and they have many additional uses.
     
    brainmasterinfo, May 3, 2011 IP
  4. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #4
    Why don't you Google the term and you would have plenty of knowledge about the subject...avoid creating new threads for the topics that have been answered thousands time.
     
    manish.chauhan, May 3, 2011 IP