Setting up my own search engine?

Is there a (free) tool/script to setup a search engine website. One where manual sites can be added and can handle atleased 50.000 websites?

 

You could try this script: http://www.isearchthenet.com/isearch/ used it, it's very good, it spiders websites, results are impressive.

Or you could take a look here: http://www.hotscripts.com/PHP/Scripts_and_Programs/Search_Engines/index.html

 

Thank you, I will look at both of them.

 

Another option if you are interested in trying something using java is nutch, which is a sub project at Apache. The project home page is:

http://lucene.apache.org/nutch/

I implemented it as a test on a windows box and it ended up indexing a million or so sites in a couple of hours over a dsl connection. The search results from within the engine were fairly quick.
You can feed it a list of sites and tell it how many levels down to go. When I played with it, I did not see where it could be limited to those 50,000 sites.
You may find it interesting, never the less.

 

http://www.cs.ioc.ee/~ando/sphider/

The best there is.

 

cool stuff. but where can i find scripts that take results from google, yahoo and msn and mix them up into a decent result search...

 

I am currently using this one, but it only supports 20.000 pages.

 

In my early internet days I was hosted for free at a British site which granted you along with the webspace your own MSN Search Engine-like... the way the claimed this:

http://www.htdig.org

 

I use Orca... http://www.greywyvern.com/orca Don't think there's any limits.

 

A few weeks ago I saw some news about amazon’s “A9” search engine. It stated that they would lend their technology for people to start their own search engine. I would really like to get more news on this subject. Does anyone remember hearing about this?






--------------------------------------------------------------------------
www.amar-ela.blogspot.com www.portugalalive.blogspot.com

 

Can you use these scripts to search google, msn, yahoo, just for one key word. Example, if I wanted to index sites that had the word “ news “, could I use the scrip to gather sites relevant to that key word?