How/where to get robot.txt file

Discussion in 'robots.txt' started by jennypretty, Feb 23, 2006.

0
  1. #1
    Hello, I have a website published for a few months, and heard lots of people mentioned about using robots.txt file to get indexed fast. Can any one please tell me about how/where to get this file?
    Big thanks.
    I just want my site to get indexed quick....
    Jenny.
     
    jennypretty, Feb 23, 2006 IP
  2. Crazy_Rob

    Crazy_Rob I seen't it!

    Messages:
    13,157
    Likes Received:
    1,366
    Best Answers:
    0
    Trophy Points:
    360
    #2
    Crazy_Rob, Feb 23, 2006 IP
  3. ServerUnion

    ServerUnion Peon

    Messages:
    3,611
    Likes Received:
    296
    Best Answers:
    0
    Trophy Points:
    0
    #3
    robots.txt is a tool to limit the areas that a search engine will index. This is great to keep it off of the "print only" versions of content if you have then. Sorry, but it wont help you get indexed faster though.

    I suggest increasing your backlinks to your site to increase your search engine exposure.
     
    ServerUnion, Feb 23, 2006 IP
  4. neroux

    neroux Active Member

    Messages:
    566
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    60
    #4
    http://www.robotstxt.org/wc/robots.html
     
    neroux, Feb 28, 2006 IP