googlebot in awstats

Discussion in 'Google' started by daboss, Feb 20, 2005.

  1. #1
    hmm... i saw an entry in awstats that said GoogleBot visited 2 times (on the 21st Feb) for a blog that i believe has been banned by google (due to comment spam which i discovered too late).

    in awstats under the "Robots/Spiders visitors" section, it simply says "GoogleBot". since the site runs adsense, could this be the adsense mediapartners robot? or is it the google search engine robot? anyone know if there will be a difference in how google's robots are reported in awstats?

    thanks!!!
     
    daboss, Feb 20, 2005 IP
  2. nullbit

    nullbit Peon

    Messages:
    489
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Check your apache logs.

    On a recent Linux distro your apache logs will usually be in:

    /var/log/httpd/access_log*

    Run this command from a shell (get a SSH client if you don't have one - search Google "windows ssh client"):
    
    cat /var/log/httpd/access_log | grep "Mediapartners-Google/2.1" | wc -l
    
    Code (markup):
    That will tell you how many times you've been hit by the Adsense bot recently.

    To do the same for the normal Google Bot:
    
    cat /var/log/httpd/access_log | grep "Googlebot/2.1 (+http://www.google.com/bot.html)" | wc - l
    
    Code (markup):
    Check out with your host where your apache logs are located if the above doesn't seem to be working.
     
    nullbit, Feb 20, 2005 IP