Meaning of spiders, robots and crawlers

Discussion in 'Search Engine Optimization' started by jell, Jan 23, 2010.

  1. #1
    Hello all

    Please clear me the major difference between of spiders, robots and crawlers
     
    jell, Jan 23, 2010 IP
  2. Quatrain

    Quatrain Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    I am no expert on the subject but let me give it a shot. A bot is a computer program that is run usually on a webserver. It can be run for extended periods of time, it might collect information to store in a database and it may interact with other websites. Bot is the umbrella term that spiders and crawlers fall under.

    So all spiders are bots, but not all bots are spiders. That having been said, spiders and crawlers are somewhat synonymous terms. They are bots that go out and scour the web looking for specific types of information. The search engines for example have bots that go out and cache and index websites.
     
    Quatrain, Jan 23, 2010 IP
  3. Rujuta

    Rujuta Peon

    Messages:
    69
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    You can read this, can get more idea:

    google.com/support/webmasters/bin/answer.py?hl=en&answer=182072
     
    Rujuta, Jul 30, 2010 IP