I saw the Latest Visitors Log of my site and it had got some hits like: /iphone/ /apple-touch-icon.png /mobile/ /m/ /mobi/ /robots.txt / The IP address was 72.44.54.44 and its from Amazon . Since it had hits to robots.txt, I think its a Spider... But I dont know why its trying to crawl the above paths.. except / and robots.txt all others had 404 Error. Did any of you had seen such hits.. Please tell me what the crawler is looking for and should I add/change something so that the site is crawled well.