New Googlebot?

[digitalpoint]

Has anyone noticed a new Googlebot lurking around?

I'm getting hit by two different kinds. The normal one:

66.249.64.47 - - [15/Sep/2004:18:59:12 -0700] "GET /robots.txt HTTP/1.0" 404 1227 "-" "Googlebot/2.1 (+http://www.google.com/bot.html)"

and also this one:

66.249.66.129 - - [15/Sep/2004:18:12:51 -0700] "GET / HTTP/1.1" 200 38358 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

Aside from the slightly different user agent, it's also HTTP 1.1. The IP address it uses is an IP block is normally just used for Mediapartners (AdSense spider), but it's spidering a site without any AdSense.

Also, the spidering pattern is different. Instead of using multiple IPs and getting groups at a time, this one seems to be a slower, steady spidering, multiple levels deep in a single pass.

[Old Welsh Guy]

This is the spider that G has developed that will read javascript and pull url's, and also can kind of read flash content. also logging as googlebot/new.

So all you javascript spammer beware

[fluke]

How on earth does it read flash? (or "kind of" read flash?)

Just looked at my log files - and i see it - didn't look to far back but it came this morning about 40 minutes after normal Gbot

[Arnica]

I had the new crawl around a week or so but not since.

Mick

[SEbasic]

Thanks for the heads up Shawn...

[xml]

I was gonna post a similar thread.

Initially I thought "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" was just someone who switched their user-agent.

That was until it grabbed 6000 pages. I got suspicious and check IP and odly enough it's on Googles IP range.

[Redleg]

I had several visits by this new googlebot a couple of days ago.
Don't remember the exact IP addresses (about 15-20 of them) but here's the IP ranges. (I did write them down on a piece of paper):
66.249.78.* 66.249.64.* 66.249.79.*

[a389951l]

Yeah just checked my log files and noticed it too.

Old Welsh Guy how do we know that it can read javascript?

[nadlay]

One of my sites normally gets hit by Googlebot at the same time each day, but for the last 3 days, I've been getting two hits, with the second coming about 15 minutes after the first.

I thought it strange, but hadn't had time to investigate, but now I look in my stats, and I'm also getting both GoogleBots, as Shawn described.

[flawebworks]

I've been getting this one all night: 66.249.65.212