I looked thru my erro log, and I saw this: My disclaimer is my forum is so dead, I dont even bother to talk to myself there. You know what I mean? No post for few weeks now. Also, my site has nothing to do with porn. It is a all legal business site. [Sun Mar 01 14:39:08 2009] [error] [client 66.249.71.114] File does not exist: .../phpbb/images/ranks/imagenes-diana-newstar.html [Sun Mar 01 14:39:09 2009] [error] [client 66.249.71.112] File does not exist: .../phpbb/images/ranks/angel-blade-free-videos.html [Sun Mar 01 14:39:10 2009] [error] [client 66.249.71.113] File does not exist: .../phpbb/images/ranks/bartender-8.0-crack.html [Sun Mar 01 14:39:12 2009] [error] [client 66.249.71.113] File does not exist: .../phpbb/images/ranks/julio-camejo-nude.html [Sun Mar 01 14:39:13 2009] [error] [client 66.249.71.113] File does not exist: .../phpbb/images/ranks/playboy-cyber-pass.html And then I lloked up the ip: 66.249.71.112 IP Information for 66.249.71.112 IP Location: United States United States Velocity Futures Resolve Host: crawl-66-249-71-112.googlebot.com IP Address: 66.249.71.112 [Whois] [Reverse-Ip] [Ping] [DNS Lookup]
I get this one. A few places have it listed as "not" the google bot. I write them down, block them, then keep an eye on the crawl access in webmaster tools. 66.249.71.113