Hey there I have a section of links that are structered like this: www.site.com/category/list/reviews/124/fr/nextpage/timtom.htm I want to remove all pages that have the /fr/ directory though because it is duplicate content, yet the number 124 is unique to the page, so i cannot simply block Disallow: www.site.com/category/list/reviews/124/fr as i would have to manually do this for 30,000 of my pages. How therefore can i block all pages that use the /fr/ in the url? thanks. Matthew
I believe that asterisk should do the trick there. So something like this maybe applies: User-agent: * Disallow: /category/list/reviews/*/fr/ Code (markup):