how can i start my own search engine?

I would like to start building my own search engine like google ?

How can I start.

Which language i use.(like dot net.,php.)

How can I start study for this type of project.

give me step by step instruction.

 

Step 1: Get Sergey Brin
Step 2: Did u get sergy aboard yet? please see step one.

 

i think you should do web as web dir then let other web submit to database

 

Umm, i dont actually know what you can do, a search engine is hard, definatly php wont work.

http://lucene.apache.org/nutch/

I never used it, but it looks good.

Rob

 

I've got one and its done with a combination of CGI, PHP and MySql. It has its own spider, and Image, MP3, News, Directory etc searches.

Its alot of work doing one from scratch. Just start small by making one that indexes your own site that returns good related results and go from there.

 

what is it for? If it was a niche specific search, can you get the other sites feed information to you? That way you can add that to your database and use mysql's match command

 

Hi i_am_dhaval

When starting a search engine you need to make a decision on whether you want a meta search engine or a normal search engine spidering websites:

1. Meta Search
This is a very simple form of search engine. You use existing search engines' results to be displayed. (i.e results are pulled from Google, Yahoo, MSN, etc.) You can decide from which sites it must come.

You control the layout of the site and results as well. This is cost-effective and easy to run.

2. Spider
If you want to start your own search engine spidering websites, you will need to spend a lot of time, hard work and money. You will use a lot of bandwidth as well as hard disk space in order to store spidered results and provide for your visitors.

Using shared hosting servers often make these search engines very slow, and visitors won't come back.

Running your own Google or Yahoo could cost you way more than a Million dollars a week once you get that far.

If you made up your mind on what you want to do, research that topic for more information.

 

and what are you gonna run this search engine on? Got a few hundred dedicated servers?

 

your 10 years to late and $100 million short apart from that its pretty easy

 

starting a search engine is easy , Open the browser and type google.com or yahoo.com and press enter that is how you start it

 

man why to make a search engine concentrate on a niche based site

 

Why don't you become a screenwriter? You could make billions with your comic dialogues

 

I would like to start building my own Country like USA?

How can I start.

Which language i use.(like English, French, Spanish)

How can I start study for this type of project.

give me step by step instruction.

 

Check out datapark It is a good one.

One another is aspseek

 

he is talking about running a search engine business

 

Don't be harsh, i think he is being serious, i think he really does what to start a search engine, i added him to MSN to ask him if he considers to co-admin one with me. I always wanted to start a search engine.

Rob

 

Its nice to see someone that have similiar mindset.

So here are two links that might give you a nice view
on the topic:

about Become.com crawler

and my topic
Cost of making and running googles scale search engine

but you might be aware that theres another technology in production
called "search engine based on natural language processing"
on http://www.powerset.com/.

It might be funny to see it work.

 

Allen I've used lucene. ITs actually great and an amazingly quick. But for huge chunk of data's it doesn't fair good. When I say huge .. I mean really HUUUUGGGGGEEEEEEE

Dhaval,
A search engine like google is not what it is because of a programming language, but coz of the optimization and they would have the best database and data mining experts working in their.

And yeah their famous Algo makes it even better search engine ! It's refined every now and then and that's what keeps them number one !

~G

 

I don't think this is as hard as you all make it out to be. There are only a couple steps.

1. Rent a garage in Palo Alto
2. Have some genius friends write a search algorithm
3. Dump a bucket load a venture capital funds in to hardware and personnel

then sit back and rake in the cash. Any vc guys out there want to partner with someone who has a garage? (I don't actually have a garage but I will get one with your vc funds.)

 

lol