After a lot of review and thought we've decided to remove our portal and focus on the search engine itself. We've been working hard for the past 6 months and have built a Web 2.0 Meta Search Engine. Pls give your comments and suggestions. Your feedback is appreciated Thank You. www.Sperse.com
What search engines are you using to gather your data? Upon examination of the search results it appears as if the lead engine is Yahoo with a secondary data source being Bing, are there more data sources than that?
Currently its using Yahoo! and Bing along with its own database and more search engines are in development phase.
That is pretty cool, but how is it's own database populated? Crawler, user submissions (did not see anywhere to do that), web directory?
Can I ask how large your database is? How much can your servers handle? How do you weight the results within your own database? I ask all this as I am looking to do the same, but I was going to buy a very expensive meta search engine script and a custom crawler with four dedicated servers to start (which says it will handle about 2,000,000 websites in the database before I need to add more servers).
Our own database is not much large at this point, but it is growing on a daily basis. Our servers are good enough to handle for the time being and will be upgraded as needed.
I am sorry if I asked too many details, I was just curious as to what you were doing as I am trying to do something similar. If you do not want to provide any more detailed answers I completely understand and I will leave you alone.
Hi Quite a nice search engine. But I did notice a couple of glitches. There is a missing graphic, showing a red X in the top left hand corner of your main page, and I tried a search from an inner page, and got redirected to your index page with no search results. Good luck...Andy
Thanks for the bug report Andy. We worked on those mentioned points and are still working to make it better day by day