Google Spiders - Analyzing Log Files

Discussion in 'Google' started by Dennis Wilson, Feb 7, 2009.

0
  1. #1
    Anyone know any good resources on the behaviour of google spiders?

    I notice various different types of visitors form Google in my log files

    For example here are 2 (real urls changed so for gawd sake dont start asking me about blue widgets ;-) )

    1) Google (216.239.45.4) [Label IP Address]

    Mountain View, California, United States, 0 returning visits

    Date Time Type WebPage
    3rd February 2009 02:11:58 Page View No referring link
    bluewidgets.com/

    2) Google (74.125.75.19) [Label IP Address]

    Mountain View, California, United States, 0 returning visits

    Date Time Type WebPage
    7th February 2009 16:08:35 Page View www.google.com/search?hl=en&q=site:www.bluewidgets.com orange-widgets
    www.bluewidgets.com/orange-widgets/

    so as you can see the second request used the site command with a keyword after the url. Was this a human reviewer then?
     
    Dennis Wilson, Feb 7, 2009 IP