How to Make Power Full Search Engine?

Discussion in 'All Other Search Engines' started by umairraja52, Oct 19, 2009.

  1. #1
    I want to make my own powerful Search Engine , so how i can make it and after that how to make powerful Search Engine amon other Search engines.

    Which code and language use for to do it. :eek: :(
     
    umairraja52, Oct 19, 2009 IP
  2. slidetheweb

    slidetheweb Peon

    Messages:
    27
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    We just had a thread open with this, hope ya got alot of patience :D
    http://forums.digitalpoint.com/showthread.php?t=1454708
     
    slidetheweb, Oct 19, 2009 IP
  3. siyamythew

    siyamythew Peon

    Messages:
    117
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    you need a lot of money for that..

    Make Business plan 1st than go for next step.. :)
     
    siyamythew, Oct 20, 2009 IP
  4. bruceslogos

    bruceslogos Peon

    Messages:
    230
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Yes you are right you need a lot of money and study the market first. And study the competitors and what software they use to create a search engine
     
    bruceslogos, Oct 21, 2009 IP
  5. FCM

    FCM Well-Known Member

    Messages:
    669
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    155
    #5
    You don't need a lot of money. I have no idea why you would say that. You need a lot of patience and knowledge in programming. It's going to be hard and not easy by any measures. Well best of luck.
     
    FCM, Oct 21, 2009 IP
  6. Ckabayan

    Ckabayan Peon

    Messages:
    167
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #6
    make pwerfull search engine ?? like google ?? so,...yor search engine algorithm must be better than google..........
     
    Ckabayan, Oct 21, 2009 IP
  7. William Tubold

    William Tubold Peon

    Messages:
    92
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    It's not that easy to maintain a search engine. It requires a lot of money, also you need:
    Search Engine Providers
    Databases
    Embeddable Search Engines and so on...
     
    William Tubold, Oct 23, 2009 IP
  8. faxodotcom

    faxodotcom Peon

    Messages:
    21
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    they are all correct. it requires lots of money and time. if you are seriously interested you can build your infrastructure on freely available tools and cheap commodity machines. The languages of choice vary with the task at hand. For features that require absolute speed C/C++ as your main staple. For glue code that isn't completely time criticial java/ruby/python are all excellent choices.
     
    faxodotcom, Oct 23, 2009 IP
  9. WebshoppeSolutions

    WebshoppeSolutions Peon

    Messages:
    139
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #9
    I've been using php for about 6 years and it is slow going. Currently I've been writing up a combination of libwww/php/js .. much faster.

    It doesn't take a ton of money really .. depending on what a ton of money means to you, but it does take research, and massive amounts of time.

    The very most important .. and I mean THE MOST IMPORTANT THING .. is establishing a GOOD REPUTATION and trust online with regard to your crawler.

    If you can't code even well enough to write your user agent string into your parsing utility, then you don't have any business being in the site search and indexing business.

    If you don't provide your own unique user agent, and provide contact info in the same string, then you won't get very far pretty fast. Professional webmasters don't have the time of day for crawlers that won't identify themselves .. and even less time for you if you don't put your results up for the world to see.

    Trust is what works in this business ... There are possibly hundreds of good intended bots out there, and they're all blocked because the guys that are running them don't even have enough sense to give their bots a name.
     
    Last edited: Oct 23, 2009
    WebshoppeSolutions, Oct 23, 2009 IP
  10. WebshoppeSolutions

    WebshoppeSolutions Peon

    Messages:
    139
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Your kidding .. right?

    You don't need search engine providers, a ton of money, or *embedded search engines .. :rolleyes:

    If you go out to start your own search engine, the last thing you want is to be showing off someone elses work .. presenting someone elses results are a waste of everyone elses time.

    All you need, is a good and honest parsing utility that can at least adhere to robots.txt and NOINDEX; NOFOLLOW protocol .. a database or two, and a few good url's to get the ball rolling.

    You'll build your database(s) at the same time you're building your reputation.

    You'll get a small following at first, and over time, as more and more people find you, you'll grow ..
     
    WebshoppeSolutions, Oct 23, 2009 IP
  11. Traffic-Bug

    Traffic-Bug Active Member

    Messages:
    1,866
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    80
    #11
    First of all you are going to need money you can count on while you work on thinking and tinkering with software objects to follow a big dream for the purpose of sustenance. Then as for languages of choice it doesnt matter what language you use as long as you feel comfortable in that language. They are saying C/C++ is very fast but that is because it has been MADE to be fast. Personally I like Pascal (not Delphi but the original Turbo Pascal). I would also prefer the word processor to be like WordStar but not like the Norton Editor (NE). May be I am more into classics kind of things. But you cant code search engine with pascal because the requisite libraries are not easily available.
     
    Traffic-Bug, Oct 23, 2009 IP
  12. sbyholm

    sbyholm Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    I'm not so sure you need C or C++ to get the speed you want. I've actually made a search engine and I find that less than 5% of the time is spent in CPU cycles doing work and 95% of the time is database queries where the main bottleneck is waiting for disk access to complete.

    That is as long as you're not running everything from RAM the speed of your programming language will not matter nearly as much as the speed of your database and your algorithms.

    Anyway if you make a meta search engine using others search results or if your make your own using free software or coding it yourself, just make sure it's useful in some way that Google isn't.

    Simon
     
    sbyholm, Nov 22, 2009 IP
  13. christyzen

    christyzen Peon

    Messages:
    647
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #13
    That powerful search engine must have unique facility than other SE like google yahoo and bing. Can you?
     
    christyzen, Nov 23, 2009 IP
  14. sbyholm

    sbyholm Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #14
    The thing that's unique with my search engine is that you can what keywords one of your pages is ranking for. I have a details page where you get a list of all keywords, inlinks and outlinks that's registered for a specific page.

    Otherwise it's pretty thin, only 250,000 pages indexed as I can't afford a better server yet :)

    Simon
     
    sbyholm, Nov 23, 2009 IP
  15. Master Directory

    Master Directory Well-Known Member

    Messages:
    3,351
    Likes Received:
    82
    Best Answers:
    0
    Trophy Points:
    135
    Digital Goods:
    1
    #15
    hehehe i agree, search engine competitor no.1 is google, i doubt u can pass google
     
    Master Directory, Nov 23, 2009 IP
  16. sbyholm

    sbyholm Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #16
    I don't need to pass Google. I just need 0.001% of the search market and I'll have a million dollar per year in revenue. I think that would be fair enough. :)

    Simon
     
    sbyholm, Nov 23, 2009 IP
  17. smivers.com

    smivers.com Peon

    Messages:
    560
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Dream on, how would you make money from it? No one will advertise with you. Do something original.
     
    smivers.com, Nov 23, 2009 IP
  18. sbyholm

    sbyholm Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #18
    AdSense on serp and other pages. What would you like to have in a search engine thats original?

    Simon
     
    sbyholm, Nov 23, 2009 IP
  19. jackbauer111

    jackbauer111 Peon

    Messages:
    113
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #19
    Just use good SEO and and thats it
     
    jackbauer111, Nov 28, 2009 IP
  20. BrassDash

    BrassDash Peon

    Messages:
    239
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #20
    Creating a search engine is just like starting a business. Put a business/financial plan together, raise the capital you'll need (and you will need it), and then begin. Don't give up, even though you will.
     
    BrassDash, Nov 28, 2009 IP