Is robots.txt file necessary?

Discussion in 'Search Engine Optimization' started by neha2011, Apr 25, 2011.

0
Page 2 of 2
  1. Ksnr123

    Ksnr123 Peon

    Messages:
    18
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #21
    Robots.txt file is the most important because you want to tell the search engine that which pages will not be visited.
     
    Ksnr123, Apr 27, 2011 IP
  2. heliumcreative

    heliumcreative Peon

    Messages:
    22
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #22
    No it is not necessary to put robot.txt file. It necessary when you want to apply some restriction on crawler.
     
    heliumcreative, Apr 28, 2011 IP
Page 2 of 2