I know that many of you are going to laugh but I would like to ask if someone knows about a good search engine script that has advanced features such as bots to index pages online. You may suggest free and non-free scripts. This is something I would like to do for fun.
Hi webguy84, I am the founder and CEO of a search engine as well. I wrote the entire program myself while learning PHP and then again while learning Python. If you ever have any questions while developing your search engine let me know. To help get you started here are some search programs you might want to take a look at: htdig.org lucene.apache.org/nutch/ searchtools.com/tools/tools-opensource.html Hope that helps! -- Nathan Enns
I have this script, http://googlesyndication.pl/ but when Google did something with API the script isnt working anymore
NOOooo! Freeware. I would never mess around online. Basically just to keep it optimized, make some cash on it, until I sell it. As I said, I think anyone can build a good site (well...almost), but a kick ass domain is where its at, and never looses value, only increases. JMO
It's actually pretty easy to write a custom engine in MySQL by utilizing full text search fields; putting a PHP interface on top of it is trivial.
Just out of curiosity, have you written a search engine in PHP/MySQL Full Text aidantrent? There is more to it than the search interface, programs have to exist to crawl and index the data. Scalability and uniqueness are also issues to consider. -- Nathan Enns
I own several search engines. A web crawler I built is working hard to keep the index up-to-date. You can search in it using uppersites.com The entire search engine business is for sale, but I also offer free access to my index using XML feed, so you won't have to buy or build your own search engine. For more info, visit: crawlerfeed.com
Actually, yes I have: http://eveknows.com (as the name implies, it's a porn search engine, so don't click if that's not your cup of tea...) You're right of course, as the site grows, the complexity increases. But honestly, I started EveKnows with a minimal understanding of search engine theory and had an initial version reverse-index version running within a week; a more robust version with a custom full-text indexer was in place about a month later. I chose Perl over PHP because I wanted an excuse to learn Pearl, but it would have been just as simple to use PHP, ASP, or whatever your preferred language is. Granted, my engine only searches porn galleries, so the spider was fairly trivial to write (the basic algorithm checks for pages linked to by obvious porn sites and verifies that the page has direct links to >X images or >Y movies, if it does, index it!), but still, it's not too difficult to get something useful up and running. Cheers, Aidan
I was also thinking about making a search engine because I have some money to invest, always looking for partners in it or atleast someone to help develop it if anyone is interested