1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

blocking directory certain part of url from robots.txt

Discussion in 'robots.txt' started by matthecool, Oct 20, 2011.

0
  1. #1
    matthecool, Oct 20, 2011 IP
  2. matthecool

    matthecool Banned

    Messages:
    71
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    18
    #2
    bump for me
     
    matthecool, Oct 21, 2011 IP
  3. pr0t0n

    pr0t0n Well-Known Member

    Messages:
    243
    Likes Received:
    10
    Best Answers:
    10
    Trophy Points:
    128
    #3
    I believe that asterisk should do the trick there. So something like this maybe applies:
    
User-agent: *
Disallow: /category/list/reviews/*/fr/
    Code (markup):
     
    pr0t0n, Nov 1, 2011 IP
  4. tiffanywilliams12i2

    tiffanywilliams12i2 Peon

    Messages:
    164
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    can you do wildcards in a url with robots?
     
    tiffanywilliams12i2, Apr 10, 2012 IP