Hi there, When I do a search using the code "site:example.com" on my domain, I found several links which seems to be not appropriate for Google to index it, according to the one who reviewed my request of reviewing it. That particular person has suggested me to block some files' link in my wordpress blog on my domain. Examples of those links : 1) http://www.example.com/blog/feed 2) http://www.example.com/blog/wp-login.php 3) http://www.example.com/wp-login.php?action=lostpassword 4) http://www.example.com/blog/wp-login.php?action=register How should I block those links from being indexed by Google or any other robots ? I do know how to block a folder from being index, but I do not know how to block a link from being indexed. Thanks in advance for your help.
Robots.txt file. User-agent: * Disallow: /blog/feed Disallow: /blog/wp-login.php Disallow: /wp-login.php The cool part is that URIs like /wp-login.php?action=lostpassword will be blocked automatically as they contain /wp-login.php