Hello, I'm wondering how is it possible to have forums that require registration to view indexed by Google? Specifically talking about vBulletin, is there a feature that allows the search engine spiders to cache the pages that would require registration to view by normal users? I know it's possible, but I don't know how to approach it.
I remember seeing such an option with AdSense or AdWords. I don't think it's possible to set anything in the Google webmasters Tools.
Hmm, well it must be possible somehow as I used to bypass registration if I wanted to look up something on the forum by using the Google cached view which made the whole post visible.
Normally they allow SE bots to see and index everything and require user to register. You can see these type of site without registering at any site that allow to view site at bot like this one http://www.avivadirectory.com/bethebot/
hxxp://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=74536 You might find this information useful
Thanks a lot, that's exactly what I needed. Although I'm sure some websites still require you to register to view the page you get taken to. So then why bother having to implement the First Click Free instance?