Hi Guys, Can any one please explain me how i can remove my supplemental pages by robots.txt file.I had read somewhere that supplemental pages can be removed by writing some code in robots.txt. If anyone from you using that code please share with me. Thanks in advance.
this can disallow the results from being crawled ... I have a question ..... what if that particular has been removed from suppli and put under normal index ??????? should i again edit the robot.txt file manually ?????????? i guess you have come out with an good answer bt i feel it doent serve the purpose
Yes, you can edit that with a simple notepad, otherwise I don't suggest you to put your supplemental pages into robots.txt. If your site will become stronger by increasing link popularity and PR leakage they will would come out from this filter.