Is there a way in Wordpress to prevent search engines from crawling and indexing certain pages? Or is it better to just use a robots.txt ?
The manual way is to create a robots page and insert each page's url there. But since you are using wordpress there is a easier way. You can use the plugin named "All in one SEO" or "Platinum SEO" and write the IDs of the pages you don't want indexed by google. The plugin then ads the noindex tag in the header of those pages. Simple as pie EDIT: I just checked and "Platinum SEO" doesn't have that option, but "All in one SEO" definitely does.