How does one go about creating a robots.txt file and placing it in a web site?

Discussion in 'Link Development' started by Sherlin, Aug 5, 2010.

0
  1. #1
    How does one go about creating a robots.txt file and placing it in a web site? I hear a lot of talk about robots.txt and how important it is for SEO.
     
    Sherlin, Aug 5, 2010 IP
  2. sheril123

    sheril123 Member

    Messages:
    101
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    46
    #2
    you can create robot.txt file using google webmasters.. and then download it and save it to your site server
    it is used to allow and block the file that you want and dont want to be crawled and indexed in the search engines.
     
    sheril123, Aug 5, 2010 IP
  3. tech0925

    tech0925 Greenhorn

    Messages:
    42
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #3
    Then simply upload it to your root directory.
     
    tech0925, Aug 5, 2010 IP