Hi there, I have a site based on osCommerce, which i am trying to optimise for the engines. My problem is that on some pages google has indexed both: http://www.mp3extras.co.uk/product_info.php/products_id/54 and http://www.mp3extras.co.uk/product_info.php/products_id/54/language/en Which have the exact same content. I am fairly sure i can use robots.txt to disallow google from doing this. But what code exactly do i use ? And as i am using a rewrite for SEO friendly URLS does this affect it in any way ? I think i am looking at something along the lines of: User-Agent: Googlebot Disallow: */language/en Or i could list each product page individually - however that would take ages. Many thanks, Eddy
that way might work, or even just User-Agent: * Disallow: /lanaguage/en Sign up for Google sitemaps and use there Robots.txt tester or something similar just so you don't shoot yourself in the foot
Brilliant, Worked a treat. Used this if anyone is interested: User-Agent: * Disallow: */language/en Disallow: */osCid Thanks