How does these sites work/function ?

Discussion in 'Programming' started by varun8211, Jan 24, 2007.

0
  1. #1
    1. PRICEGRABBER.COM
    2. MOMONDO.COM
    and many similar price comparison and extraction websites.

    Does anybody know how does these comparison sites work ? Do they actually crawl the other websites and extract the data and if yes, how ? They must have some crawler which does that ?

    Please help me understand their concept..

    Thanks
     
    varun8211, Jan 24, 2007 IP
  2. danielldf

    danielldf Well-Known Member

    Messages:
    402
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    130
    #2
    well in brazil the biggest is bondfaro.com.br works having direct access to each site that he show in searchs results..
     
    danielldf, Jan 24, 2007 IP
  3. Eadz

    Eadz Peon

    Messages:
    108
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #3
    They crawl the websites and extract the data. To do this they have to write a parser for each website, because the html and layout code for each site is different.

    There are libraries in most programming languages that will help you do this. Search for 'screen scraping' and you will get some idea of what is involved.
     
    Eadz, Jan 31, 2007 IP