How do these search engines get started. Bing! has only been up for a couple years...and it's getting big! How do you get something like this going. What type of hosting capabilities are required?
Bing has been around for a lot longer than a few years .. MSN Live Search was rebranded to become Bing .. they've been around a while. If you want to start your own search engine, and I don't mean using Google's API, you might start with either writing or purchasing a site parsing script .. Be sure that it obeys the Robots.txt exclusion protocols and the most important is to NOT run your Bot/Parsing Agent from any Cloud (Amazon AWS) .. Bots from the cloud are blocked by default, so you won't get anywhere pretty quickly. Host your site/parsing agent on a dedicated ip address and use your own database(s) for search .. And put up an info page that describes your bot and what it does .. be sure to name your bot with a unique name (user agent), so that others will know that it's you, and not some other script that's parsing their site. These are the things that will gain you the legitimacy you'll need if you ever plan to be a search indexing success on the internet.
accept of bing there has been many search engines in which you can submit your site and it will be so profitable for your site. like google,yahoo and many more search engines you can find on google.
i seconded on this...bing has been there for a very long time (MSN -> Live -> Bing) thats how it goes... starting a new search engine is one tough thing to do.. takes lot of work and effort
Search engine working is hard to control and script control, further more, much money will be invested in the project including promotion. They are really tough work.
Google is the exception .. not the rule Besides, Google is an ad server, first and foremost .. Google quit being a *genuine search engine sometime back in 2005
Consider how you would * crawl websites * store the information * query it quickly * query it accurately * stop SEO abuse so that the right results are given, not the manipulated results I'd be impressed if you could complete a crawl... let alone any of the other steps
If I were you I'd start a niche search engine ! Try to reindex all web in your personal computer hard drive does not make any sense! Find a niche, a special domain or information and make a search engine for this dedicated domain. For example I created search engine for PDF files/documents, see one in action at PDFsearcher.com Let me know if you need help or partner in your quest! Cheers!
Building your own search engine website is tricky but it can be done. I built a specialized investing search engine a couple years ago that actually worked very well, great search results for those who used the website. Ended up too much work for the small number of users, I didn't really market sufficiently. The biggest obstacle is getting people to use your search engine, need to do a lot of advertising, other search engines are not going to send you traffic. Need to focus on a niche so you can focus on getting specific users that will use your search engine If you can invest in a bunch of advertising or have other websites with tons of traffic of the right users it might be worth trying. If you come up with a marketing plan and need help with the search engine send me a pm.