What's the USER_AGENT googlebot using?

Discussion in 'Site & Server Administration' started by microtony, Jun 14, 2005.

  1. #1
    I need that to track how frequent that Google crawls to my sites.
    Thanks you all.
     
    microtony, Jun 14, 2005 IP
  2. Sjorritsma

    Sjorritsma Peon

    Messages:
    238
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Sjorritsma, Jun 14, 2005 IP
  3. microtony

    microtony Peon

    Messages:
    281
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    0
    #3
    thanks. ;)

    btw, what's this Mediapartners-Google/2.1
     
    microtony, Jun 14, 2005 IP
  4. Trepan

    Trepan Peon

    Messages:
    73
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I got Mediapartners-Google when I put adsense on some sites.

    Last week I have been seeing this on 2-3 sites:
    Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

    I has crawled quite a lot of pages too. Is it google or some rogue bot spoofing it's agent?
     
    Trepan, Jun 14, 2005 IP
  5. Sjorritsma

    Sjorritsma Peon

    Messages:
    238
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Yesterday it was on my website with the user_agent

    Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
    ipadress 66.249.65.204

    a nslookup gave me

    Name: crawl-66-249-65-204.googlebot.com
    Address: 66.249.65.204

    I suppose it's a googlebot
     
    Sjorritsma, Jun 14, 2005 IP
  6. T0PS3O

    T0PS3O Feel Good PLC

    Messages:
    13,219
    Likes Received:
    777
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Mediapartner is the AdSense bot. Not an indexing bot but a bot that determines the subject it should spawn ads for.
     
    T0PS3O, Jun 14, 2005 IP
  7. Trepan

    Trepan Peon

    Messages:
    73
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Good to know that it's a google bot (the one with mozilla user-agent), it has crawled about 1k pages so far. I hope they get indexed too, only 50 so far...
     
    Trepan, Jun 14, 2005 IP