Google bots on forums

Discussion in 'Google' started by hunter22375, Jul 30, 2008.

  1. #1
    All my forum permissions set to where you have to register to view them (guests and not logged in cannot view). Is it true that google bots are treated as guests and therefore will never register all the new content in the new posts because they automatically ignore them?
     
    hunter22375, Jul 30, 2008 IP
  2. Robert T

    Robert T Peon

    Messages:
    105
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Robert T, Jul 30, 2008 IP
  3. hunter22375

    hunter22375 Well-Known Member

    Messages:
    162
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    101
    #3
    Thanks Robert. Can anyone tell me how to do this? I'm on a shared server and I cannot find where I might accomplish this in the admin CP. Can I change my robots.txt file to do this?
     
    hunter22375, Jul 30, 2008 IP
  4. Robert T

    Robert T Peon

    Messages:
    105
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Implementation of this requires some care. It is simple enough to use javascript/php to check the user agent and ip addresses, identify googlebot (etc) and not redirect the bot to the login page. That said, serving up different content based upon user agent can create problems that resemble cloaking which can get you removed from the index.

    So, if you don't find someone that has experience with vbulletin here you might ask at the vbulletin forums.
     
    Robert T, Jul 30, 2008 IP
  5. WishBone

    WishBone Peon

    Messages:
    2,566
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Google bots didn't know how to register and have their own log ins. :)

    Of course, there's no privacy at all when all log in protected sites and their contents can searched on search engines.
     
    WishBone, Jul 30, 2008 IP