Would this block?

Discussion in 'robots.txt' started by NaSh123, Aug 26, 2008.

0
  1. #1
    NaSh123, Aug 26, 2008 IP
  2. Syndicated Content

    Syndicated Content Banned

    Messages:
    33
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    AFAIK the slash at the end disallows the whole content inside that directory.
     
    Syndicated Content, Aug 27, 2008 IP
  3. goliathus

    goliathus Peon

    Messages:
    93
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Disallow: /category/

    blocks
    - example.com/category/
    - example.com/category/123.html


    Disallow: /category

    blocks
    - example.com/category/
    - example.com/category/123.html
    - example.com/category-123.html
    - example.com/category123.html

    I hope you see the difference ... first disable all content in the folder and the second one disable all with prefix "category" - all folders and files...
     
    goliathus, Aug 28, 2008 IP