Question

Discussion in 'robots.txt' started by eXe, Feb 15, 2007.

0
  1. #1
    Will this block just the folder users, or the folder website too?
     
    eXe, Feb 15, 2007 IP
  2. andriusk

    andriusk Well-Known Member

    Messages:
    367
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    140
    #2
    As much as I understand it should block only folder users
     
    andriusk, Feb 16, 2007 IP
  3. eXe

    eXe Notable Member

    Messages:
    4,643
    Likes Received:
    248
    Best Answers:
    0
    Trophy Points:
    285
    #3
    A look at http://www.digitalpoint.com/robots.txt leads me to believe the same:) 

    Disallow: /tools/suggestion/?
    Code (markup):
     
    eXe, Feb 20, 2007 IP
  4. Jean-Luc

    Jean-Luc Peon

    Messages:
    601
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #4
    It will block all the following:
    /website/users/
    /website/users/my_file.html
    /website/users/sub_directory/my_file.html
    /website/users/my_script.php?country=us&city=25
    /website/users/startrek/

    It will not block any of the following:
    /website/
    /website/users
    /website/copy/
    /users/john.html

    Jean-Luc
     
    Jean-Luc, Feb 20, 2007 IP