Pre-Alpha Search Engine.

i like the site it looks simple i think it needs a bit of colour on it but other than that as pre alpha its pretty good, i know you mentioned aout selling but why not run it as a preoper search engine? do the desig then work on getting people to use it add some extra features such as a free email account? probs cant compete with google/yahoo yet butif you give people something to keep coming back you may 1 day have 1 of the big 4? (or 5 with surch )

 

This is a nice site. What is the daily/monthly search number

 

good concept, needs a little work though
http://www.dimensionethost.com/comet/search3.php?s2=cash
Will add it to my directory of search engines though.

 

Thanks! http://www.cometquery.com is the new URL.

 

very interest

 

Algorthm has changed, and hopfully you can see that! As far as http://cometquery.com/search3.php?s2=Cash goes it should of changed a little in the sense of results.

 

We have been very busy today, first of all I saw my sister of for a year, upsetting . But hey Search before life! We added some new things today and worked on the algorithm, which I am almost certain everything will think it is a BIG improvement.

Lets go into more detail:

First new thing is the report as spam, this is a mission to remove spam not caught by our system. To report a site as spam just click the small [sp] button, then read, then see if you still think the site if spam. If so click agree and the site will first of all show people the number of people that have reported it as spam and it will also get one of our Quility Control team to check out the site and ban it if it turns out to be spam. (As we dont like filtering, you WILL be able to search also with spam filter off)

Next is the algorithm change, which took AGES and we are still tweaking it to our liking. The new algorithm provides the type of results you would want, if you still dont think the Algorithm is not perfect show us a example search and we shall get back to work!

Next is something you wont see however makes alot of change in how the search engine works, the Live crawl has got a few more servers so more live crawls can be done at once, which means more results, faster! We are aiming for LC to go down to 0.4secs, currently it stands at 1.1secs.

I would also love to thank you kind DigitalPoint users,
Thank you from me and the rest of the team.

 

Wow - I was actually surprise at the quality of the results. Good job so far - sounds like you are using the feedback from users to really improve.

 

Thanks Phynder, speaking of which any comments on what could be improved OR added?

 

Just a update, added a new funtion. C-Rank. C-Rank is NOT ment to work the same way as Google pagerank so dont try and see if they compare. C-Rank takes in alot of things to base its results, here are SOME.

Links In.
Links in with content about site \ page with over 250 words.
Number of adverts
Advert \ Content Ratio.
If been reported as spam \ adult.
Human intervention.

A example of the ranking: http://cometquery.com/search3.php?s2=site:digitalpoint.com
Or another:http://cometquery.com/search3.php?s2=site:google.com

 

TVcokeCan thanks for the explanation and you're right I should ask more some questions so here goes.

You say that you are coming out with things that META engines CANT like an api to feed meta engines right? Well companies like Surch.com have this ability already and for a long time now, so does mamma and dogpile so meta engines are fully capable of providing a feed AND a better feed as its a combination of results that are sorted by the meta into the most relevant content of all data found. So I'd say with respect to a META or Crawler engine for that matter, you have no clue what you are talking about. Surch has posted in their thread about their PPC API and results API.

Additionally, Surch.com HAS ITS OWN CRAWLER and I believe so does MAMMA, DOGPILE and a few others. As to crawler engines, there are literally tons of them... anyone can goto source forge and download a number of them but to effectively run one you NEED a very large server farm... If this were not true in your case then man, you really have something and should call Google and tell them to sell the plex and their acreage of server farms consisting of hundreds of thousands of servers all over the world.

Additionally when you refer to a alg, you are correct in your assumption that no1 would give out the alg's secrets, but any engine will tell you if its custom in house written or not, unless they are some fly by night deal. They will also like Google, explain as to what it is based on like PageRank for Google... for which there are many articles written about...They would explain like many meta's right on their homepage what engines or external data sources they are using etc...

After careful review I am almost sure yours isn't custom otherwise you would have applied for international patents and trademarks before EVER posting in even pre-alpha which from a check I can see that so far the corp. you list in your signature hasn't nor has any company applied for a patent with respect to a search engine alg in some time. So if you have applied please post the info here so we can check it out...and YES even Google gives you their patent application numbers so this isn't asking for some "secret" bit of info.

This isn't to at all bash on you or your engine I do like it but, posting things like "its better than a META and META can or cannot do this or that" and making statements like "we are better than Google" without any truth or factual basis only degrades to the professionalism of this community and the accuracy of the content found on Digit Point. Many that create, recreate or improve upon technologies tend to get a little over zealous and its understandable. Its not easy to perform these types of things so again I'm just trying to give you constructive criticism.

I have no doubt that you may have modified a decent script and I DON'T at all think its a poorly written/modified engine but I did wonder where are you getting your data from. I know now from your IM to me that you are grabbing data from Google and MSN (which is not the definition of a crawler engine) but you make the suggestion that its live crawling and that you are NOT a META? what does this mean exactly? For instance I typed in the country of Vanuatu to your engine....now there is no way that your engine could pull the results it has unless it was getting its data from somewhere ( by your own admission MSN, Google) as does a meta engine especially in 1.5 seconds if it was as you say a crawler based engine... Its just not possible trust me, and if you want I can explain fully why this is the case but the simple fact of the matter is that YOU ARE A META ENGINE so again you don't know what you are talking about.

In short IF YOU WERE A CRAWLER BASED ENGINE you would be too new to have had someone type in "Vanuatu" (an island country with something like 10K people located in the south pacific) yet so I make this claim based on knowing that Vanuatu .com hasn't been cached or stored in your DB if you are in fact even caching or storing data... So if you were in fact a "true crawler" you would have had to crawl the entire net and index the results based on something like googles PR to retrieve this that fast. Additionally I just looked up my page and your info is up to date but I only made a change to it just recently so, you are either crawling my site (which I checked and see nothing that suggests you are from my logs) or getting the data from a larger company (again you told me you are using Google and msn) In the case of your claim to be a crawler you would have massive storage devices already....Do you? From your IM to me you told me you are running only 2 servers...so the answer is then, NO YOU ARE A META.

But still I'm wondering what you mean by your Live Crawling...please explain how you think your script isn't a meta?

Its possible that you are NOT receiving millions of queries per day and if that is the case I can see how you could cache a few query results that you are taking from Google and msn but I don't see how you can say this is being a "live crawler" And caching wont last for long on a few servers....

Also you are using iframes to bring content in...you are getting those screenshots from msn and your data is from Google and MSN... YOU ARE "crawling others data" so I hope that you have a feed agreement with them otherwise when or if you do get some decent traffic or they notice your site THEY WILL SHUT YOU OFF PERMANENTLY. If you need me to link googles policy on this let me know.

Another thing, you claim to have an alg right? well if you are crawling msn and Google and returning their results as you are then you don't. You said in your recent post that you modified your alg but YOU DON'T HAVE ONE. At best you have some .pl or php script that is taking data from Google and MSN.... THIS IS NOT AN ALG. ITS A SCRIPT AND THERE ARE LITERALLY THOUSANDS JUST LIKE IT. Also, if you are just giving us results from Google then why am I going to use your engine again? Why wouldn't I just use Google, msn, yahoo, ask, AltaVista etc....

Again, this isn't to pick on you but its to point out obvious inaccuracies in your statements and an effort to keep this forum clean. If you really want to start an engine and become a player in the market I'd suggest doing some more homework OR be honest about what it is that you have to offer.

One last thing...How do you figure or how can you make the statement that you are "BETTER THAN GOOGLE" if you are using their results? I think you should give credit to whom it is do.

 

Just a note:

This person quotes many times from a MSN convo, in which I told him the system of the search engine, however many things I did not say and on request and agreement with him I shall post the whole MSN log. Not once did I say we use Google & MSN. I think he is on a mission to try and de-rep our search engine and he has not provided ANY proof for his comments. I have tryied to be nice but tbh this person is just TRYING to be a jerk. He quotes many things that I just simply never said. Such as saying we are better than Google, search this topic if you wish for me even saying the word Google!

No, I am saying there is SOME things Meta can not do, if you have the power of a crawler you can find and do stuff with data in which other cralwers dont provide.

Well then I should contact Google. I don't think 120MB is that big for 100,000 results personally.

I have done so, the Algo was written by me and my team, we do not use external data sources at current, nor do we have any plans to.

We are doing this for some extra pennies not to become rich. I can't afford trademarks ect and I think that logic is failed.

If I did not think we could do better as in results we would not be making it, the only real truth is to try and work it out for yourself.

I am willing to show you some sections of source code to prove this fact, however only under extreme sets of rules. The engine works by keeping a data log of links and does not crawl them untill a keyword that linked to them is called, that is the speed. And excuse me Sir, I think you will find I understand a meta-search engine and a real one!

Meta Crawlers use results from other search engines and display them, we don't. Simple as really.

Do you have ANY proof of this? The only thing we take from MSN is the screenshots, and we are in contact with Microsoft under this area.

Once again, I dont see where you think you have proof or ANYTHING?

Tbh I think your either with another search engine or directory or are just jelous for some reason. We have been honest from post one and can you point out ONE inaccuracie?

You really are joking right? You have no evedance of us using Google, nor have I ever said so?



One last thing, I have been extremly truthful is this topic for one reason, I had the goal of being able to sell the system that powers this, granted I have now be put of doing so by the great comments people have given.

 

I can back cokecan up on the fact that this is a custom script, I have seen the source code, and also him coding it.

 

Can I also say, I LOVE as much as anyone else some Meta-Search engines for example surch.

 

1. TV I dont work with any other engine so that is not it. The fact is that your post and comments lack truth and facutal basis and as I said

...not to mention you completely contridict yourself. You just said that

You want proof HERE:

http://cgi.ebay.com/Search-Engine-N...8QQihZ019QQcategoryZ46689QQrdZ1QQcmdZViewItem


Read at the bottom in YOUR statement:

So DO NOT sit here and call me a liar.


2. you say:

You completely contridict yourself because in your previous response to my post you say:

So you SAID META ENGINES CANNOT DO AN API. SO DONT TRY AND BACKTRACK HERE AND CALL ME A LIAR AGAIN. Also a meta engines ability to crawl or not HAS NOTHING TO DO WITH THE ABILITY TO PROVIDE A XML DATA FEED. YOU DO NOT KNOW WHAT YOU ARE TALKING ABOUT.

Yeah I just did.