hi. i want make something like dogpile but with more option. i think its possible write a script to extract search result from google and other engines then combain and show them to user. but there is a problem. google recently if u search too much from same IP show you a captcha to make sure you are not a bad bot ... how i can solve that problem ? anybody can help me on this project ?
Dude i don't think you are going to get the proper answer here. i actually came to this post just for the topic. but actually can't help
To understand what a meta search engine is, first you have to understand how a search engine works. The search engine visits billions of websites and creates a database or repository of sorts of the various sites. This is known as the index. Then whenever a user enters the search query, something magical happens (algorithms if you are a computer geek) and the pages that are deemed relevant to what you asked for are returned. Pretty simple, huh? If only you could improve those magical algorithms you could create the next Google (although Google is smart enough to hire you instead!).
Metasearch engines create what is known as a virtual database. They do not pile up a catalogue or physical database of the web. Instead of they receive a user's request then pass it to numerous other heterogeneous databases and then gather the outcome in a homogeneous manner based on a particular algorithm.