Crawler And Spider

Hi All,

I just want to clear about Crawler and Spider. They are same ? or both have different meaning. I will Highly appreciate if any one clear this.


Thanks

 

A spider is nothing more than a computer program that follows certain links on the web and gathers information as it goes.

and A web crawler is a script that scans Internet pages to create an index of data. Also called a bot.

 

Hi Russlls,

Thanks for the reply.

 

I am agree with the answer provided by Russels that it is a computer software which are used by the search engine to crawl a web page.

 

A spider crawls links and send the data to the search engine data center.A crawler scans the web pages in some specified techniques following algorithms.

 

A spider is a program run by a search engine to build a summary of a website’s content (content index). Spiders create a text-based summary of content and an address (URL) for each webpage.Spider and robot are same but crawler is different from these.
Crawlers are very active, and often account for a great deal of the visitors to websites all over the internet. The Google crawler, known as Googlebot, is particularly active, and will often visit a website several times a day, checking for updates or new information. Studies have shown that it is much more active than other crawlers, the closest being the Yahoo crawler, which is about half as active as Googlebot.

 

I think that both are different work. like spider a browser link program that downloads web pages and crawler a program that automatically follows all of the links on each web page.

 

Thanks to all for Support.!!!

 

I am agree with Russels.

 

Both have different meaning.

 

Thanks for sharing this information...........