Hi everyone, After upgrading my CMS over a month and a half ago, it seems like Google still indexes my old URLs. I submitted these URLs to be removed in the Webmaster Tools but got a notification stating that I have to use robots.txt in order to remove the requested URLs. Here's an example of how my URLs look: www.mysite.com?menu=story&Co=352309 www.mysite.com?menu=story&Co=622251 www.mysite.com?menu=story&Co=152513 What do I need to put in my robot.txt to eliminate these dynamic URLs? Would something like: Disallow: /?menu=story&Co=352309 suffice? Would a line like Disallow: /?menu=* do the trick? Also, I have folders and sub-folders I do not want to be indexed. Let's say that the folder is /test/. So if I write a line Disallow: /test/ would all the subfolders under test not going to be indexed as well? Thanks.
yes it is also a problem many time indexed url are difficult to remove just follow these add a no-follow to your links or in your robots.text, you can too make it easily by google webmaster tools