the best tool

Discussion in 'XML & RSS' started by leejohn, Nov 4, 2011.

  1. #1
    the best tool to create robot.txt file .and tell where it put at server level and why.
     
    leejohn, Nov 4, 2011 IP
  2. gauravmultiplex

    gauravmultiplex Peon

    Messages:
    37
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    We put the robots.txt file in the root folder.
    A robots.txt file restricts access to your site by search engine robots that crawl the web.

    For more information read: google.com/support/webmasters/bin/answer.py?answer=156449
     
    gauravmultiplex, Nov 7, 2011 IP
  3. afitzone

    afitzone Member

    Messages:
    140
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #3
    how its work???
     
    afitzone, Nov 21, 2011 IP