Spy the Google Bot

Discussion in 'Google' started by fedoras, Aug 24, 2007.

0
  1. #1
    It is possible to see if the google boot was on some part or folder on your site, in awstats i can see last time he was on the site but i can not see where :confused:
     
    fedoras, Aug 24, 2007 IP
  2. Amator

    Amator Well-Known Member

    Messages:
    1,424
    Likes Received:
    55
    Best Answers:
    0
    Trophy Points:
    165
    #2
    Do you have access to your log files ?
    You should be able to see it in there.
     
    Amator, Aug 24, 2007 IP
  3. fedoras

    fedoras Active Member

    Messages:
    197
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    53
    #3
    The logs from Apache ?
     
    fedoras, Aug 24, 2007 IP
  4. venetsian

    venetsian Well-Known Member

    Messages:
    1,105
    Likes Received:
    61
    Best Answers:
    0
    Trophy Points:
    168
    #4
    SEO Website CMS has a module called "BOT TRAP" and it captures all search engine bot activity on file/folder basis. See attached screenshot:

    [​IMG]

    The CMS is only available with MAIAHOST.COM due to management issues.

    Cheers,

    Venetsian
     
    venetsian, Aug 24, 2007 IP
  5. Doug the Great

    Doug the Great Peon

    Messages:
    548
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    0
    #5
    I love how you refer to the Googlebot as "he".
     
    Doug the Great, Aug 24, 2007 IP
  6. Amator

    Amator Well-Known Member

    Messages:
    1,424
    Likes Received:
    55
    Best Answers:
    0
    Trophy Points:
    165
    #6
    yes, indeed.
     
    Amator, Aug 24, 2007 IP