Hello, My WP links look like this: http://www.example.com/2007/11/11/post-title/ I don't want search engines to index feed pages of posts and comments, for example, in the previous example I want to block the following pages: http://www.example.com/2007/11/11/post-title/feed/ http://www.example.com/2007/11/11/post-title/comments/feed/ Can this be done by adding the following to my robots.txt file? Disallow: /*/*/*/*/feed/ Disallow: /*/*/*/*/comments/feed/
Disallow: */feed/ will block all feed pages to be indexed. I'd suggest using feedburner to syndicate your main feed