1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

What does this robots.txt text mean?

Discussion in 'robots.txt' started by Jon12345, Jan 8, 2008.

0
  1. #1
    I have this in robots.txt:

    User-agent: *
Disallow: /dw/
    Code (markup):
    What does that actually mean? What will it do?

    Thanks,

    Jon
     
    Jon12345, Jan 8, 2008 IP
  2. Dr. XYZ

    Dr. XYZ Guest

    Messages:
    226
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #2
    That means that search engines must not get into your dw directory for indexing purposes.

    ·​
     
    Dr. XYZ, Jan 8, 2008 IP
  3. Jon12345

    Jon12345 Peon

    Messages:
    599
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #3
    That's very odd...I don't have a dw directory. If I wanted to disallow 2 directories ("images" and "surveys"), how would the robots.txt file look?
     
    Jon12345, Jan 8, 2008 IP
  4. Kuldeep1952

    Kuldeep1952 Active Member

    Messages:
    290
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    60
    #4
    To disallow the 2 directories ("images" and "surveys"), put each directory on a separate Disallow line

    User-agent: *
    Disallow: /images/
    Disallow: /surveys/
     
    Kuldeep1952, Jan 8, 2008 IP
  5. Jon12345

    Jon12345 Peon

    Messages:
    599
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Thank you. :)
     
    Jon12345, Jan 8, 2008 IP
  6. ld685

    ld685 Peon

    Messages:
    18
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    test signature
     
    ld685, Jan 21, 2008 IP
  7. SwapsRulez

    SwapsRulez Peon

    Messages:
    32
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #7

    What does that mean ???? :confused:
     
    SwapsRulez, Jan 21, 2008 IP
  8. catanich

    catanich Peon

    Messages:
    1,921
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Have you set up your User CP Signature (menu <User CP>
     
    catanich, Feb 2, 2008 IP