my robot.txt

Discussion in 'robots.txt' started by cahyoaja, Mar 23, 2010.

0
  1. #1
    what kind of permission should we use for our robot.txt file? what is best permission?
     
    cahyoaja, Mar 23, 2010 IP
  2. Sketch5646

    Sketch5646 Peon

    Messages:
    11
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    i should read more articles because i start seeing myself very small without knowledge
     
    Sketch5646, Sep 28, 2010 IP
  3. SeoDelo.com

    SeoDelo.com Peon

    Messages:
    57
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Possible without this service the file do ... blocking indexing pages using tags ;)
     
    SeoDelo.com, Sep 30, 2010 IP
  4. seoguy5

    seoguy5 Peon

    Messages:
    160
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    yes the tags are the main role for blocking/allowing the robots from following and reading your web pages. you can find a big list of tags regarding the robots.txt commands.
     
    seoguy5, Oct 3, 2010 IP