Google crawling non existing sites or using forms?

Discussion in 'Site & Server Administration' started by muaythai, Jul 11, 2006.

0
  1. #1
    I've sew some odd things from googlebots for example my proxy the bot crawls it and seem to use it.

    I see alot of these:

    GET /cgi-bin/nph-proxy.cgi/000110A/http/www.website.com HTTP/1.1" 200 -

    I've seen a similar behaviour for other non proxy sites. Any one knows what the googlebot is doing?
     
    muaythai, Jul 11, 2006 IP