Hi, Here I am discussing about my website which has a big problem. qwertyc.com is my personal website. Actually I found many unusual or wrong urls in my site like this: [TABLE="width: 656"] [TR] [TD="class: xl64, width: 656"]http://www.qwertyc.com/index.php?option=com_content&view=category&id=8 [TABLE="width: 656"] [TR] [TD="class: xl65, width: 656"]http://www.qwertyc.com/products-and-services/website-design/8-promote[/TD] [/TR] [/TABLE] [/TD] [/TR] [/TABLE] When I found many urls like this then I disallowed these all in robots.txt file as: User-agent: * Disallow: /?* Disallow: /9-prevent Disallow: /8-promote Disallow: /7-home/ Disallow: /10-protect I am unable to remove all these thats why I had to take help of robots.txt. My main problem is that all these links are showing like before in webmaster tool. Is there any solution for removing these links from Google Webmaster Tool. And I also want that whenever any user open this link, it should never show on my site. Please reply me soon. I am in waiting for yours positive reply.
once it gets crawled you have to manually remove it otherwise you have to wait longer for it to disappear, I just suggest you to 301 redirect all the dead links to the homepage
on the other side you can redirect them to the permanent links. so that it will not appear in the results.
Play around with .htaccess, setting up two or three all-catching rule rewrites, redirecting all with a 301 somewhere SEO safe.
robots will help these url not to be crawled in the future, but it may take awhile for google to remove them also your "Disallow: /8-promote" does not disallow hxxp://www.qwertyc.com/products-and-services/website-design/8-promote
We also did the same on our corporate site www.webnethosting.net, its a good way to redirect to permanent links.