Google Bot issue..

Discussion in 'Site & Server Administration' started by davcheong, Oct 24, 2005.

  1. #1
    I am using phpbb for my forum.. lately i notice that google is trying to loggin on and poof gone.. how am able to let google to crawl in my forum?
     
    davcheong, Oct 24, 2005 IP
  2. mdvaldosta

    mdvaldosta Peon

    Messages:
    4,079
    Likes Received:
    362
    Best Answers:
    0
    Trophy Points:
    0
    #2
    remove session ID's for guests
     
    mdvaldosta, Oct 24, 2005 IP
  3. davcheong

    davcheong Well-Known Member

    Messages:
    1,148
    Likes Received:
    51
    Best Answers:
    0
    Trophy Points:
    175
    #3
    how? where is the session ID resided?
     
    davcheong, Oct 24, 2005 IP
  4. aeiouy

    aeiouy Peon

    Messages:
    2,876
    Likes Received:
    275
    Best Answers:
    0
    Trophy Points:
    0
    #4
    # 
    #-----[ OPEN ]------------------------------------------ 
    #  
    
    includes/sessions.php 
    
    # 
    #-----[ FIND ]------------------------------------------ 
    # 
    
    $SID = 'sid=' . $session_id; 
    
    # 
    #-----[ REPLACE WITH ]------------------------------------------ 
    # 
    
    if ( $userdata['session_user_id'] != ANONYMOUS ){ 
       $SID = 'sid=' . $session_id; 
    } else { 
       $SID = ''; 
    } 
    
    # 
    #-----[ SAVE/CLOSE ALL FILES ]------------------------------------------ 
    # 
    # EoM 
    
    Code (markup):

    This is from the Able2Know SEO Mod.
     
    aeiouy, Oct 24, 2005 IP
  5. l234244

    l234244 Peon

    Messages:
    1,225
    Likes Received:
    50
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Also you can ban googlebot via robots.txt from accessing login.php page.
     
    l234244, Oct 24, 2005 IP
  6. davcheong

    davcheong Well-Known Member

    Messages:
    1,148
    Likes Received:
    51
    Best Answers:
    0
    Trophy Points:
    175
    #6
    thanks for the tips. Great tips.
     
    davcheong, Oct 24, 2005 IP
  7. davcheong

    davcheong Well-Known Member

    Messages:
    1,148
    Likes Received:
    51
    Best Answers:
    0
    Trophy Points:
    175
    #7
    huh?? ban googlebot in robots.txt? how?
     
    davcheong, Oct 24, 2005 IP
  8. mdvaldosta

    mdvaldosta Peon

    Messages:
    4,079
    Likes Received:
    362
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Here's my robots.txt

    My forum is in a subfolder "forums/" so if your is different you would need to change it. Just make a file called "robots.txt" and put it into your root directory (whether your forums are there or not).

    User-agent: * 
    Disallow: /forums/admin/ 
    Disallow: /forums/images/ 
    Disallow: /forums/includes/ 
    Disallow: /forums/language/ 
    Disallow: /forums/templates/ 
    Disallow: /forums/common.php 
    Disallow: /forums/config.php 
    Disallow: /forums/groupcp.php 
    Disallow: /forums/memberlist.php 
    Disallow: /forums/modcp.php 
    Disallow: /forums/posting.php 
    Disallow: /forums/profile.php 
    Disallow: /forums/privmsg.php 
    Disallow: /forums/viewonline.php
    Disallow: /forums/search.php
    Disallow: /forums/faq.php
    Code (markup):
    This keeps google bot (actually all bots) from entering these areas of my forums.
     
    mdvaldosta, Oct 24, 2005 IP
  9. davcheong

    davcheong Well-Known Member

    Messages:
    1,148
    Likes Received:
    51
    Best Answers:
    0
    Trophy Points:
    175
    #9
    checking it out now..nice of you all.
     
    davcheong, Oct 24, 2005 IP
  10. davcheong

    davcheong Well-Known Member

    Messages:
    1,148
    Likes Received:
    51
    Best Answers:
    0
    Trophy Points:
    175
    #10
    the robots.txt should place it in the forum directory or the root?
     
    davcheong, Oct 24, 2005 IP
  11. mdvaldosta

    mdvaldosta Peon

    Messages:
    4,079
    Likes Received:
    362
    Best Answers:
    0
    Trophy Points:
    0
    #11
    it goes in the root
     
    mdvaldosta, Oct 24, 2005 IP
  12. davcheong

    davcheong Well-Known Member

    Messages:
    1,148
    Likes Received:
    51
    Best Answers:
    0
    Trophy Points:
    175
    #12
    oops.. error typo.. didnt read clearly. sorry man. root. Can i put it in my forum directory?
     
    davcheong, Oct 24, 2005 IP
  13. mdvaldosta

    mdvaldosta Peon

    Messages:
    4,079
    Likes Received:
    362
    Best Answers:
    0
    Trophy Points:
    0
    #13
    no, bots look for it in the root
     
    mdvaldosta, Oct 24, 2005 IP
  14. eric923456

    eric923456 Active Member

    Messages:
    19
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    88
    #14
     
    eric923456, Oct 27, 2005 IP