Please read my thread here: http://forums.digitalpoint.com/showthread.php?t=2250097 This is probably a better category for my topic, as I got no any reply in the Programming forum.
Well, you can either disallow that particular page in robots.txt or add noindex meta tag to that page.
Can you tell me how the noindex meta tag should look exactly? And can I also use it if I don't want to index a certain text on my site? And what should I write to the robots.txt?
You have 2 options for it, 1st one you can use noindex, nofollow in Meta tag, 2nd one is you can block that page through Robots.txt file... both are correct, choice is yours.. The tag will exactly look like:- <meta name="robots" content="noindex, nofollow" />
If you install google webmaster tools you can edit the robot.tx file in that. Or in the 'Crawler Access' tab you can submit your url to be romoved the the 'Remove URL' tab Have never tried this but hope it helps.Â