What is the different between a "crawler" and a "spider"?

What is the different between a "crawler" and a "spider", in terms of SEO?

 

I would have thought they meant the same thing, a spider crawls a site for pages right?

 

Crawlers are mainly used to create a copy of all the visited pages for later processing by a search engine that will index the downloaded pages to provide fast searches.

Many sites, in particular search engines, use spider as a means of providing up-to-date data. This is a piece of software that scans your web pages and collects data for indexing.

 

Thank you for clarifying this for me as well, I was always somewhat confused when it cam to their exact definitions and their roles.

 

they are the same. A web spider is a piece of software that scans your web pages and collects data for indexing. They possess no intelligence. They just collect information for search engines such as google. The google guys set algorithms that affect search engine ranking. They don't disclose these algorithms to anyone. .

 

As far as my knowledge goes, its the same software program with different names. Spider/Crawlers/Robots catch-all, or generic term for programs and automated scripts that “crawl” through the web (the Internet) and collect data from websites and anything else on the Internet that they can find.


Web Development Services
Web Element, Inc.

 

Spider - a browser like program that downloads web pages.

Crawler – a program that automatically follows all of the links on each web page.

 

The difference between Spider and Crawler is quite clear - they are both very similar but do different close functions at the same time.

 

Spider - a browser like program that downloads web pages.

Crawler – a program that automatically follows all of the links on each web page.

 

I look at both the same. I only use "spider" to describe it as a noun. I use "crawling" to describe it as a verb.

 

most of the sites, in particular search engines, use spidering as a means of providing up-to-date data. Web crawlers are mainly used to create a copy of all the visited pages for later processing by a search engine that will index the downloaded pages to provide fast searches.

 

both are same..but do different close functions at the same time

 

Spider - a browser like program that downloads web pages. Crawler – a program that automatically follows all of the links on each web page. A spider, also known as a robot or a crawler, is a program that follows, or "crawls", links throughout the Internet, grabbing content from sites and adding it to search engine indexes. Dusmant

 

Yes, That's a closely answer i agree with them.

 

Both the search engine spiders and crawlers perform same functions, that crawls throughout the internet and grabbing content from sites and adding it to search engine indexes.

 

Crawler and Spider are the same search engines goes in a Website for particular pages. They are same...

 

I think Crawler and Spider are same.
If you get information about them please discuss on this Forum also.

 

thanks, cleared it up for me.

 

Hello............

Search engines use a crawler (also called a spider or robot) to crawl the web, following hyperlinks from one page to the next, in order to index web pages for their database. Some links use the "nofollow" tag to prevent a spider from passing on page rank from the link.