Difference between Spider,Crawler & Robot

Discussion in 'Search Engine Optimization' started by hanhash2006, Sep 8, 2009.

  1. #1
    HI

    I have found these definition

    Spider - a browser like program that downloads web pages.

    Crawler – a program that automatically follows all of the links on each web page.

    Robots - An automated computer program that visit websites & perform predefined task.

    They are guided by search engine algorithms & are able to perform different tasks instead of just one crawling task. They can combine the tasks of crawler & spider together and help in indexing and ranking of websites on any particular search engine.

    Let me know Is it right ?
     
    hanhash2006, Sep 8, 2009 IP
  2. MoneyTopList.com

    MoneyTopList.com Active Member

    Messages:
    314
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    88
    #2
    You have probably found the exact definitions but these words are usually used as synonyms.
     
    MoneyTopList.com, Sep 9, 2009 IP
  3. tstewart

    tstewart Peon

    Messages:
    308
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Nice information about Difference between Spider,Crawler & Robot thanks for sharing
     
    tstewart, Sep 9, 2009 IP
  4. amit-seo

    amit-seo Peon

    Messages:
    33
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    ya dear ,

    this is right but these all are known as same aspect.
     
    amit-seo, Sep 9, 2009 IP
  5. wsitehelp

    wsitehelp Guest

    Messages:
    288
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Difference between Spider,Crawler & Robot thanks for sharing.
     
    wsitehelp, Sep 9, 2009 IP
  6. ITchimes1

    ITchimes1 Peon

    Messages:
    147
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Thank you for this informative post.
     
    ITchimes1, Sep 18, 2009 IP
  7. ebleu

    ebleu Peon

    Messages:
    78
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Looks like an exact definition. Thanks for sharing.
     
    ebleu, Sep 18, 2009 IP
  8. indiannews007

    indiannews007 Member

    Messages:
    239
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    28
    #8
    Hi,

    Thx for clear this question and i m agree with this point of view about crawler and spider.
     
    indiannews007, Jun 2, 2011 IP
  9. essrt123

    essrt123 Peon

    Messages:
    42
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Thanks for sharing the difference between Spider,Crawler & Robot.This is really beneficial information for me.
     
    essrt123, Jun 2, 2011 IP
  10. Tessa_86

    Tessa_86 Peon

    Messages:
    281
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Yes. You have differentiate each term very clearly. Also this seems to be exactly right. Robots.txt is an automated computer program that can be visited by Search Engine bots.
     
    Tessa_86, Jun 2, 2011 IP
  11. faysal969

    faysal969 Member

    Messages:
    901
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    33
    #11
    Nice and useful definition. Thank you very much for sharing those nice definitions.
     
    faysal969, Jun 2, 2011 IP
  12. vijay.kishore

    vijay.kishore Peon

    Messages:
    1
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Sypler are codes written to fetch part of data from a web page based on arthemetic or logical conditions. Example Sypler can find a customer service number on a website where the text is pre or post matching with either "tool free", "service", "contact", etc from a single or miltiple defined website or a google surch result. There Sypler code can be written in excel macros or can build a web application. Sypler fetch data only on request bases as and when required.
     
    Last edited: Mar 6, 2012
    vijay.kishore, Mar 6, 2012 IP
  13. anna30

    anna30 Well-Known Member

    Messages:
    281
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    123
    #13
    There three words have the same meaning.
     
    anna30, Mar 6, 2012 IP
  14. robken

    robken Member

    Messages:
    52
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    48
    #14
    Spiders, Crowlers, Robots are different words to define the automated programs which are written to do crowling through the web. The crowlers are automated so they are called Robots and they are crowling the web (internet) so they are called Spiders.
    Robots do the predefined tasks which are to download we pages and follow the links on those pages.
     
    robken, Mar 6, 2012 IP
  15. zunedseo

    zunedseo Greenhorn

    Messages:
    87
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    18
    #15
    According to my knowledge, there are no Difference between Spider,Crawler & Robot except name.
     
    zunedseo, Mar 6, 2012 IP
  16. wbgclient

    wbgclient Greenhorn

    Messages:
    48
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #16
    Thank you for the exact definition. I also think that we use all of these terms to describe the same thing.
     
    wbgclient, Mar 7, 2012 IP
  17. seoakram

    seoakram Peon

    Messages:
    117
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #17
    A crawler is a program that visits Web sites and reads their pages and other information in order to create entries for a search engine index. The major search engines on the Web all have such a program, which is also known as a "spider" or a "bot." Crawlers are typically programmed to visit sites that have been submitted by their owners as new or updated.
     
    seoakram, Mar 7, 2012 IP