Interesting... I new domain i have, i placed a Robots.txt disallowing all useragents from the whole website. Google is now on there spidering the forums calendar. Not happy!
Unfortunately you are right, there are known cases of wrong behavior of google robots. you should submit it to the G.
I agree with sweetfunny. I disallowed all my PDFs from all search engines through robots.txt bcos of duplicating issue and guess what google bot did? My all PDFs are crwaled and have PR 3... I think there is no use of Robots.txt.
Yes, sure is correct. I've been a webmaster before Google even got rolling, and failing to follow robots guidelines in something i've heard about but never tested on a new domain with nothing indexed. Yet here was Googlebot attempting to index a vBulletin forum calendar. IP/Useragent confirmed in latest visitors and the forum whos online. Hmm, i think i'll have to do more testing on this.
Interesting indeed - have you contacted Google about this? That would be the first logical step towards rectifying the problem.