Is it possible to have Google & other search engines list my webpages but not make the cache public? I don't want the cache to be present because some pages will contain information that might need to be confidential in the future. In such cases the pages will be changed on our server but the cache may still allow the public to see the confidential information. At the same time, we wish our listings to appear in Google as normal. Is there a way to keep the cache private but still have the same Serps?
Webmaster world do this so you have to be a member to see the posts and you can't just look at the cached pages. It really annoys me. If you have confidential information you should not really allow google to spider it. You can either add a <META NAME="robots" CONTENT="noarchive"> ntag to stop your pages being cached.
<META NAME=\"ROBOTS\" CONTENT=\"NOARCHIVE\"> Will this stop all cache but still keep the pages in the serps? Does this work with all search engines?
You may also want to disallow archive.org. It does not look at the robots metatag (which works fine for search engines) but needs a directive in your robots.txt file. See this: http://www.archive.org/about/exclude.php