Robots.txt

Discussion in 'WordPress' started by kamatsingh, Jun 23, 2011.

0
  1. #1
    I recently purchased a wordpress based blog and he has a very big robots.txt file. Can someone help me structure it right? I mean i just want the search engines not to access the administration side of the site. i just was the spiders to index the images and the posts that i publish. Can anyone please point me to the correct way to create such a robots.txt file?

    Thanks
     
    kamatsingh, Jun 23, 2011 IP
  2. Civin

    Civin Well-Known Member

    Messages:
    371
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    138
    #2
    Civin, Jun 23, 2011 IP
  3. daljit

    daljit Well-Known Member

    Messages:
    312
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    101
    #3
    daljit, Jun 24, 2011 IP
  4. mim24

    mim24 Well-Known Member

    Messages:
    327
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    103
    #4
    mim24, Jun 24, 2011 IP
  5. beven

    beven Well-Known Member

    Messages:
    483
    Likes Received:
    1
    Best Answers:
    1
    Trophy Points:
    113
    #5
    i have hear a lot of about this Text file. What is its benefits & where we can found it
     
    beven, Jun 25, 2011 IP
  6. armanefendi

    armanefendi Peon

    Messages:
    19
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    i am a newbiew of blogger, i like this topic... thx
     
    armanefendi, Jun 25, 2011 IP