Robot.txt

Discussion in 'robots.txt' started by srinet, Jan 19, 2007.

  1. #1
    How robot.txt file is important to index my domain in the Google.
    How create robot.txt file to index well my domain in Google
     
    srinet, Jan 19, 2007 IP
  2. seo_kate

    seo_kate Peon

    Messages:
    362
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #2
    seo_kate, Jan 19, 2007 IP
  3. explorer

    explorer Well-Known Member

    Messages:
    463
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    110
    #3
    You've posted in the wrong forum - this should be in the robots.txt forum, not the Google forum, but I'm sure that'll soon be taken care of.

    As seo_kate says, you use robots.txt to keep spiders out of parts of your site you don't want indexed. You can't use robots.txt to make Google or any other spider index your site any better. The quality and quantity of indexing is determined mainly by who links to you.
     
    explorer, Jan 19, 2007 IP
  4. mani

    mani Peon

    Messages:
    679
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #4
    robots.txt does not help you in indexing your site.. it only prevents you to index those directories or pages which you don't want to be indexed
     
    mani, Jan 19, 2007 IP
  5. tomten

    tomten Peon

    Messages:
    41
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    It is good idea to have robots.txt also because googlebot is expecting to find it on your webspace.
     
    tomten, Jan 19, 2007 IP
  6. Toldo0o

    Toldo0o Peon

    Messages:
    40
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #6
    robot.txt creation and all thing are here


    http://www.outfront.net/tutorials_02/adv_tech/robots.htm
     
    Toldo0o, Mar 28, 2007 IP
  7. reachpradeep

    reachpradeep Well-Known Member

    Messages:
    1,180
    Likes Received:
    79
    Best Answers:
    0
    Trophy Points:
    115
    #7
    i think robot.txt is more important file in server
     
    reachpradeep, Apr 9, 2007 IP
  8. RECEP

    RECEP Well-Known Member

    Messages:
    1,855
    Likes Received:
    23
    Best Answers:
    0
    Trophy Points:
    195
    #8
    its not much important than if u want to prevent crawlers acceess to ur private folders , thats all.
     
    RECEP, Apr 11, 2007 IP