How do you think designing a search engine?

Well don;t get discouraged. I also wanted to build one and am getting near it. Right now you can see a demo of my current finished work at http://www.juhy.com Let me know if you need any help.

 

Lol.. i have a google clone kinda thingy like abt 500kb .

Its some web api.. put your adsense codes and voila.. you have a google search engine working on your own BRANDING name paying you good dollars

 

Hello, if you are talking about actual design then all you need is something very simple, bearing in mind the features you wish to include. However, if you are talking about actually creating one then, as previously mentioned, you're going to need a lot of investment.

 

DAMN DAMN DAMN awesome... Can you be kind enough to send me the source codes :rofl:

 

Well Man it is not finished yet. But I will let you know when it is finished. And yeah I will not be giving you source code. Maybe an ecrypted version for you to use on one of your domains.

 

Find the better algorithm than Google.

Prove your algorithm with just 100s of websites.

 

LOL, I think I know the script you are talking. Couple of days ago I also found this script from a whares site. Actually, this is not the Google script LOL. This is just trying to access a database that does not even exist.

 

Nick, none of the links in bottom of your page are working. 404 page non found is getting returned.

 

But Remember... It is illegal to use Google trademarks and logos without having their written permission.

 

@NICK :

I dont care if its encrypted man... Im happy as long as i have a search engine wherin i can sell ad links ..lol

@nvduria

Lol man.. it was working just fine which means it connects to google database . It gets results from google and everything.. totally brandable etc.

 

Is that all??? Piece of cake

 

Yeah man I am that much engulfed in coding that I forgot to make simple HTML pages for Terms and other things

 

You guys have no idea.
You simply copy the script from scroogle (google without spying) that uses google in the background onto your own site. Then you disguise it properly and you are set.
Now you are using google in the background but noone knows. Google pais for the hardware and the engineering and you get rich.


In case you havent noticed my sarcasm, it was.

 

No offense but I think you don't get it. Google's API's are only free for 1000 queries for 24 hours. And what if your traffic goes beyond that.

If you parse the page directly without the API's then I think it is against the TOS of Google and it may bring trouble.

 

Forgot one thing. If you want your own crawler and your own ranking algo (So that you can tune it to cheat on your own site )

Then go for datapark

Search it in google you will know what I am telling.

If still you are not satisfied then I have other suggestions too.

Try aspseek

And if you are still not getting it then PM me I have researched this thing from last 1 and half years and Know how much resources each script may need. Will you need dedicated server or not. Etc etc. If cralwed websites are less then 100,000 pages then no need for dedicated it can be done on a shared. In your crawling process how much depth you are looking for. Are you going to follow the URL's that are linked from the crawled page?

I have lots and lots of things that I can mention here. And believe me in real time when you start setting it up. It is very tough. You will even be tempted to leave it in middle.

If you stick to it then it may take 3 or 4 months or may be a year. And without any knowledge of the scripts or even not knowing the name of the scripts puts you in a bad situation. So hire some guy who has experience in this.

I am not advertising myself But I have done this kind of job before If you are interested commercially then let me know. I usually charge 10 to 12k's for the setup.

 

Don't think you'll have much luck with building a search engine if you don't know much about programming, otherwise you'd need alot of capital to start a new search engine

 

You'll probably want to use an existing project rather than starting from scratch, such as Harvest. It's doable if you only want to crawl a small subsection of the web (I was thinking of doing one for Linux Ham radio a year or so ago) but anything more than that would probably require you to get to gribs with distributed storage and communications, which is still an evolving area.

 

Not that hard you do not need $$$$$$$ you jsut need X,XXX if you do it the right way and have knowledge, First you need to make something new that no search engine has done. I recommend using dataparksearch.org that is the source it has 5000 threads. you will need to have root access on your server and have a very good one. Post on some forums and market with adwords saying submit your site here. etc. With the money that you have, except for the marketing. hire a coder to make something that would be simple and be of great value. then post it on digg.com after you have alot of pages indexed. and cached. have a filter created that is very good and your done.

 

Nice looking results pages. One problem. I tried 2 different two-word searches and got the following error

"could not open XML input"

 

I am thinking of opening a purely MANUALLY INDEXED, CATEGORIZED, and REVIEWED search engine/directly using cheap outsourced labor. Is it too late for this? What would be the "something extra" that would convince an enduser to use my site instead of Google?