Hi, We have designing new search engine for that we want script that detect spell error and automated keywords suggestion for that spell error. Is there any free script code for that structure, please let me know.
Detecting search errors would all depend on what data your crawler is gathering, how you've formatted your database etc. I have developed a search engine myself (nothing ever published just to say "i can do it!") using a multitude of technologies. I found the hardest bit was the searching (using binary tree's etc) and that spell checks were really not too hard once you've got the rest sorted. As you can never predict new words, phrases slang etc etc the best way to approach this problem is to compare the search string against recently popular search strings and check for comparible words, if the "slang" is out then this will become apparent to the server and can offer the correct, more popular phrase. Andrew
you will have a lot of work on your hands to get this up and running but most of your results will come from the accepted solution your users choose from your list of suggested results to calculate which like results is the best solution
Hi there Catherine86 I've been coding a web 3.0 app (auto content generator like IBM's Watson - shameless promo ) that's pretty much in your line of necessity, http://blog.afterthedeadline.com/2010/03/04/all-about-language-models/ simple api call to his function(s) may do the trick. ROOFIS
Also forgot to mention, for the front end you'll need to run some sort of runtime auto complete script/lib something like YUI 2: AutoComplete for instance, developer.yahoo.com/yui/autocomplete developer.yahoo.com/yui/examples/autocomplete/ac_fn_multfields The YUI Library is issued under a BSD license (similar to the GNU free software license) Great example of it's usage: adult meta engine offers search-as-you-type. You could configure a suggest.php spelling lib page to append to the lib for spell errors - search suggestions etc. similar to the search engine mentioned above. ROOFIS
well i think there is no perfect tool for that, you can use some ready scipts but you have to do your own code for that. autocomplete scripts there are a lot, just google it, but the code, you have to do it yourself.If you use mysql, you need to use some queries with REGEXP or LIKE %% to get aproximate or possible matches for suggestions. You can try with google spell checker class for spelling.
he wanted to obtain completed free code I saw function which compared text with similar mysql records but I do not remember name :/
Probably, though OP could be looking for some direction too. PHP has some nifty functions like soundex and metaphones/double metaphones for spelling applications. Lawrence Philips offers a Open Source Spell Checker utilizing the metaphone algorithm and a PHP Implementation of the double metaphone algorithm is available too. This combined with all the other replies should be able to give Catherine86 a good head start at least. ROOFIS
You can use this corpus for your script: http://nlp.stanford.edu/links/statnlp.html You can also use OpenNLP. BTW You should take a look at this article before working on any search engine. I used work for a company which was trying to create a search engine. https://ecpmblog.wordpress.com/2011...tly-incurs-about-5-10-billion-in-fixed-costs/