Actually, they do, that is exactly what search engines (=machines do) crawling billions and billions of sites everyday. Speak with webmaster of really big sites, they will explain to you that they have to restrict the times the Google bots come to their sites, because they eat up bandwidth! SY