How to make Robots.txt

Discussion in 'robots.txt' started by iBullet, Mar 21, 2011.

0
  1. #1
    iBullet, Mar 21, 2011 IP
  2. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #2
    It is quite simple. You need to first create a robots.txt file that will include following lines:

    User-agent: *
    Disallow: /the folder or file you want to hide from search engines

    Once you are done with this, upload this file in root folder of your website.
     
    manish.chauhan, Mar 22, 2011 IP
  3. iBullet

    iBullet Member

    Messages:
    153
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    30
    #3
    thank you for your help
     
    iBullet, Mar 22, 2011 IP
  4. Ebiyee

    Ebiyee Peon

    Messages:
    7
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I think now you got your answer
     
    Ebiyee, Mar 23, 2011 IP
  5. vijay01

    vijay01 Peon

    Messages:
    13
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Thanks for sharing this information about robot.txt. it help me for interview board.
     
    vijay01, Mar 23, 2011 IP
  6. techntuts

    techntuts Member

    Messages:
    197
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #6
    create an empty file named robots.txt and then sign up for google webmastertool and then you will have an option to select which folder to disallow and which folder to allow.
     
    techntuts, Mar 26, 2011 IP
  7. vinoth.t

    vinoth.t Peon

    Messages:
    156
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #7
    You can create and configure robot.txt file in easy and simple steps. Just create a robot.txt and upload it in your server. This link will help you to configure your robot.txt file in a better way.
    How to Create Robot.txt File
     
    vinoth.t, Mar 26, 2011 IP
  8. alenn

    alenn Banned

    Messages:
    134
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    @ manish.chauhan : Thanks for sharing wonderful information about robot.txt
     
    alenn, Apr 4, 2011 IP
  9. brad.smith4321

    brad.smith4321 Peon

    Messages:
    249
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    its perfect manner
     
    brad.smith4321, Apr 4, 2011 IP