How to: On Making Robots

Discussion in 'robots.txt' started by mrsmirf, Nov 23, 2009.

0
  1. #1
    I am looking to find a beginner how to guide for making robots. If you have any info please post.
     
    mrsmirf, Nov 23, 2009 IP
  2. GSP

    GSP Greenhorn

    Messages:
    60
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    18
    #2
    Visit robotstxt.org
     
    GSP, Jan 24, 2010 IP
  3. tata_capl

    tata_capl Peon

    Messages:
    461
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Go To Google Webmaster Tools > Site configuration > Crawler access > Generate robots.txt > Select Appropriate Option > Copy File > Create Robots.txt on Root - You are done.
     
    tata_capl, Mar 14, 2010 IP