What does this robots.txt text mean?

Discussion in 'robots.txt' started by Jon12345, Jan 8, 2008.

  1. #1
    I have this in robots.txt:

    User-agent: *
    Disallow: /dw/
    Code (markup):
    What does that actually mean? What will it do?

    Thanks,

    Jon
     
    Jon12345, Jan 8, 2008 IP
  2. Dr. XYZ

    Dr. XYZ Guest

    Messages:
    226
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #2
    That means that search engines must not get into your dw directory for indexing purposes.

    ·​
     
    Dr. XYZ, Jan 8, 2008 IP
  3. Jon12345

    Jon12345 Peon

    Messages:
    599
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #3
    That's very odd...I don't have a dw directory. If I wanted to disallow 2 directories ("images" and "surveys"), how would the robots.txt file look?
     
    Jon12345, Jan 8, 2008 IP
  4. Kuldeep1952

    Kuldeep1952 Active Member

    Messages:
    290
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    60
    #4
    To disallow the 2 directories ("images" and "surveys"), put each directory on a separate Disallow line

    User-agent: *
    Disallow: /images/
    Disallow: /surveys/
     
    Kuldeep1952, Jan 8, 2008 IP
  5. Jon12345

    Jon12345 Peon

    Messages:
    599
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Thank you. :)
     
    Jon12345, Jan 8, 2008 IP
  6. ld685

    ld685 Peon

    Messages:
    18
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    test signature
     
    ld685, Jan 21, 2008 IP
  7. SwapsRulez

    SwapsRulez Peon

    Messages:
    32
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #7

    What does that mean ???? :confused:
     
    SwapsRulez, Jan 21, 2008 IP
  8. catanich

    catanich Peon

    Messages:
    1,921
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Have you set up your User CP Signature (menu <User CP>
     
    catanich, Feb 2, 2008 IP