Pls explain practically with example are crawler & spider same if yes then why two names and if no pls explain.
crawler is one which visits your site and spider is one which indexes your site - once the crawler visits the site,, spider comes into action... spider asks the crawler to visit the links which you are pointing from your site... n after crawler have visited those links.. spider indexes those links too!!