What is the IP of a google bot/spider?

Discussion in 'Google' started by ricelover, Mar 4, 2008.

  1. #1
    I have no way of telling, from my stats, whether a visitor is a human, or a bot.

    So what is the IP, or IPs of google's bots/spiders? What is it's city/country of origin?

    What proportion of my website does it crawl? How much time does it spend on each page? Are the times equal for each page?

    Thanks in advance. :)
     
    ricelover, Mar 4, 2008 IP
  2. mcfox

    mcfox Wind Maker

    Messages:
    7,526
    Likes Received:
    716
    Best Answers:
    0
    Trophy Points:
    360
    #2
    There are hundreds of IPs for Google spiders.
     
    mcfox, Mar 4, 2008 IP
  3. Funky

    Funky Peon

    Messages:
    37
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    You can get lots of stats about the googlebot if you register wour site within the google webmasters tools.

    Give you info about popular search result keywords, indexed pages and will warn you of any problems like pages not found etc.
     
    Funky, Mar 4, 2008 IP
  4. Simonh

    Simonh Peon

    Messages:
    45
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I have heard that if you try to get too close to the Googlebot you may get penalised. Any attempt to analyse or manipulate it could be fatal for the site.

    Most basic stats packages provide information about bots and spiders. If yours does not install another one. My advice, be sure that your intensions are honourable.
     
    Simonh, Mar 4, 2008 IP
  5. sray

    sray Active Member

    Messages:
    298
    Likes Received:
    29
    Best Answers:
    0
    Trophy Points:
    70
    #5
    Check awstats, you'll get details of all type of visitors - human, from search engines, bots, robots, aliens all :)
     
    sray, Mar 4, 2008 IP
  6. fabriciogr

    fabriciogr Active Member

    Messages:
    958
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    73
    #6
    awstats is probably one of the best opensource stat software that can detect bots and name which ones are visiting your site, time they've been crawling and pages crawled..

    another really good stat software is webtrends but unfortunately it's not opensource. so u'd have to roll out the dough there.. :( :( :(
     
    fabriciogr, Mar 4, 2008 IP
  7. wantmomoney

    wantmomoney Peon

    Messages:
    239
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    I agree with the last two suggestions. If your stat reporting software doesn't distinguish between real visitors and bots, then you need to get some different stat software. All of the stat programs I use distinguish and will even filter bots out of the statistics. A good free one to use is www.statcounter.com.
     
    wantmomoney, Mar 4, 2008 IP
  8. freespace

    freespace Well-Known Member

    Messages:
    718
    Likes Received:
    15
    Best Answers:
    1
    Trophy Points:
    140
    #8
    Also make sure you have reverse DNS resolution turned on in your stats else you won't see the name of the host. Google sometimes does not use the user agent when spidering sites.
     
    freespace, Mar 4, 2008 IP