Hi all, I have a another question, we are doing a site that has a members only section.we want to know how to get the search engines to those pages even though you need a user name and password to get to them. This may be possible or not, if yes, please explain how? Thanks
If the search engines can get to them then humans will be able to get to them. the best you can do is "cloak" so that you detect browsers. I know for a fact that people do surf while pretending to be bots (otherwise why would I get hits from msn, yahoo and googlebot all on the same IP) so it's not foolproof. I'm guessing that you want the bots in there to drive traffic in who then need to sign up. Perhaps you could create teaser pages with only part of the information - and they need to register to see the whole thing. But show the bots and the people the same thing. safer and more ethical.