My first phase of project is to build up a search engine. It can also be with a normal searching technology or algorithm. On reading some of the explanations on working of search engine, i could see that there are 3 steps. crawling indexing queryng I have a doubt here. The first step CRAWLING. How does it take place? How google manages to go to a web page. Like how will it come to know when a new website is created? How will it identify a new website is created and will crawl. Because after it gets crawled it will be added up in the index and periodic crawling will be done. But i find this problem. How will i find a web site or a page for the first time. I also need assistance in building up a search engine. I welcome all kinds of help and suggestions in building it. I find this forum to be very useful because of the techies available here. Expecting your help guys. Thanks.
First question is why? Next is what's it going to be about? What strategy will you use to gain market share? the going will not be easy, first you're required to skim the surface to this point - Google - . The target area is only 2 metres wide, it's a thermal exhaust port right above the main port. It's ray shielded, so you'll have to use photon torpedos from the Starship Enterprise, and battery acid from Thunderbird 6. hehehe sorry, couldn't resist. But another search engine, dont you realise you'll get your ass handed to you by the other engines? Please, please assure me that this isn't another Google killer..... I've lost count of the hundreds of search engines that say they will bring down the Google giant, and where are they now My only advice is don't do this or you'll end up losing your house over it or much worse. You'll need 300k a month until it's established - forget it, it's a wacky dream. A search engine by all means, but make it a niche one, no Google killers, you won't have the cash for that.