Product Data Feeds or possible website crawling for data

Discussion in 'Affiliate Programs' started by aboo4733, Mar 14, 2010.

  1. #1
    Hi, I am trying to create a price comparison engine. Here are some examples, pricespider.com, google price comparison, etc. Basically these engines are nothing new but I did have a question on how they aggregate product data. I know that product data feeds are out for use (i.e. popshops.com) but the information on these sites is limited. It doesn't have the amount of product info that I desire for my concept. I want information to the extent of Amazon.com products or pricespider.com products. My question is - where do they get this extensive product information? Is it available in the form of datafeeds online? If not, do I have to go directly to the 1000's of merchants to get datafeeds?

    I have already asked Amazon if I could crawl their website for product information and they gave me a hard NO. There is no way Amazon put together this data by themselves. It must have come from somewhere (whether it is merchants or data feeds or something else).
     
    aboo4733, Mar 14, 2010 IP