Jux2.com, how are they doing this ?

[Percept]

Hi,

most of you have probably heard of the new "searchengine" www.Jux2.com which lets you pick 2 searchengines and compares the results to serve the overlapping results. It's a nice idea but I don't understand how they are doing this. I thought a Google API license restricted the number of queries a day to 1000, so how are they able to query the Google index without having to worry about the limitations ? I also searched for a Yahoo API but couldn't find one so how are they getting the results from Yahoo ? ( didn't look for an AJ API ).

The other thing I don't understand, is why Google, Yahoo and Ask Jeeves allow this since it's direct competition that's pulling people away from the original SERP's (with the ads).

Anyone an idea maybe ?

PS: might be interesting to read this page (http://www.jux2.com/stats.php), it shows some stats on the different SERP results.

[Percept]

Noone an idea ?!

[mopacfan]

Wow, that's pretty cool. I had not heard of this this service. I like the way the present the results. I guess they must have paid some large sum of money to be able to use the data from the three SE's they use.

[digitalpoint]

It appears they are screen scraping the results. Many times you will get no results from Yahoo with it, when in fact there are. That is because Yahoo throttles the number of requests by IP address. So they are sending too many requests to Yahoo, and many times getting nothing back from Yahoo.

[Percept]

Thanks for the explanation Digital Point, I suspected they were scraping but I thought the SE's didn't allow this ?

[digitalpoint]

When you drive, do you speed? It's not allowed you know. :)

People do lots of things that aren't "allowed".

[Percept]

Yeah sure, but it's a lot eayer to catch scrapers then speeders, so I don't understand why Google, Yahoo, ... let this happen. They can sue them easely.

[mxlabs]

that's still a good idea, bookmarked :)

[digitalpoint]

They don't need to sue them... all they would have to do is block their IP (which they have done in the past).

[Percept]

Well if I know about this Jux2, Google will too, so I don't see what they are waiting for :)

[digitalpoint]

Maybe they don't care because they aren't big enough to pay attention to.

[anthonycea]

How do all the other Meta Search Engines get results from the big players?

They make deals with them, all of these Meta Search engines have links back to the big engines in the SERP's.

Yahoo results are used on a lot of private label search engines and so are Google results.

How do the following proxies get their results?

www.googlebattle.com

www.googlewar.com

[vlead]

I just saw jux2... it's a neat concept. The most relevant results concept is cool.