How do you think designing a search engine?

Discussion in 'All Other Search Engines' started by fesite, May 26, 2006.

  1. #1
    I want to design a search engine,how do you think it?:confused:
     
    fesite, May 26, 2006 IP
  2. mad4

    mad4 Peon

    Messages:
    6,986
    Likes Received:
    493
    Best Answers:
    0
    Trophy Points:
    0
    #2
    First you need a couple of billion $$$$'s. Then you need to hire experts from the other search engines.

    Then build a hardware infrastructure to store your index. Then crawl the web to get all the pages in an index.

    Now you need to write an algorithm to rank the pages for all the search queries.

    Once this is working you need to market the search engine to everyone.
     
    mad4, May 26, 2006 IP
  3. emitind

    emitind Peon

    Messages:
    567
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Yeah, good luck :)
     
    emitind, May 26, 2006 IP
  4. vegabond

    vegabond Shabu Anower

    Messages:
    1,656
    Likes Received:
    289
    Best Answers:
    0
    Trophy Points:
    240
    #4
    Pls crawl my sites at first :D. Just kidding :)
     
    vegabond, May 26, 2006 IP
  5. urlstand

    urlstand Well-Known Member

    Messages:
    519
    Likes Received:
    78
    Best Answers:
    0
    Trophy Points:
    128
    #5
    When I will start thimking I will let you know but till then best of luck :)
     
    urlstand, May 26, 2006 IP
  6. Lpspider

    Lpspider Well-Known Member

    Messages:
    2,216
    Likes Received:
    56
    Best Answers:
    0
    Trophy Points:
    160
    #6
    Dead-on mad. That's very accurate, though you might be able to start out with a few hundred million.
     
    Lpspider, May 26, 2006 IP
  7. saadahmed007

    saadahmed007 Admínistratör

    Messages:
    5,272
    Likes Received:
    869
    Best Answers:
    0
    Trophy Points:
    380
    #7
    Good luck,But i think it needs alot of investment.
     
    saadahmed007, May 26, 2006 IP
  8. maldives

    maldives Prominent Member

    Messages:
    7,187
    Likes Received:
    902
    Best Answers:
    0
    Trophy Points:
    310
    #8
    Not a bad idea. Good luck!
     
    maldives, May 26, 2006 IP
  9. Rage

    Rage Well-Known Member

    Messages:
    3,062
    Likes Received:
    122
    Best Answers:
    0
    Trophy Points:
    190
    #9
    Rage, May 27, 2006 IP
  10. seoindiaweb

    seoindiaweb Banned

    Messages:
    2,889
    Likes Received:
    200
    Best Answers:
    0
    Trophy Points:
    0
    #10
    may be u can buy ready 2 go script;) PPC script for $100;) lol.. n enjoy makin money:D
     
    seoindiaweb, May 27, 2006 IP
  11. tsep

    tsep Peon

    Messages:
    178
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #11
    ;) try a directory first..maybe it not need a few bilion $$$$..I can setup one directory for you. just need pay me 50$...:D
     
    tsep, May 31, 2006 IP
  12. nvidura

    nvidura Well-Known Member

    Messages:
    1,780
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    150
    #12
    I am serious. If you really want, you may well build one. However, do not try to build search engines identical to existing ones. Try to implement new algorithm.
     
    nvidura, Jun 2, 2006 IP
  13. nvidura

    nvidura Well-Known Member

    Messages:
    1,780
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    150
    #13
    In programming, there are valuable things than money.
     
    nvidura, Jun 2, 2006 IP
  14. Rage

    Rage Well-Known Member

    Messages:
    3,062
    Likes Received:
    122
    Best Answers:
    0
    Trophy Points:
    190
    #14
    for example ????
     
    Rage, Jun 2, 2006 IP
  15. nvidura

    nvidura Well-Known Member

    Messages:
    1,780
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    150
    #15
    I guess you don't know anything about programming…
     
    nvidura, Jun 2, 2006 IP
  16. poseidon

    poseidon Banned

    Messages:
    4,356
    Likes Received:
    246
    Best Answers:
    0
    Trophy Points:
    0
    #16
    well if you are really serious than you can use Lucene. It's a open source library available in languages like C++/Python/Java. Using lucene you can create inverted index of text documents and at front end you can create a user UI through which you can search the index and show the result documents.

    But creating a index of thousand documents is alot different than creating a index of billion documents :)
     
    poseidon, Jun 2, 2006 IP
  17. kynast

    kynast Well-Known Member

    Messages:
    7
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    106
    #17
    For a niche search engine you may want to check out Dataparksearch. It is open source and also written in C. With the right hardware seaches are fast with an index in the hundreds of thousands although I have not reached a million yet. :) An example http://www.newslookup.com/

    Compared to Dataparksearch, Lucene-Nutch is a high learning curve but does scale into the millions. Dataparksearch has however always been very actively in development and believe plans to scale are not too far off. If I ever planned to move my index size into the millions and upgrade hardware to support it my first stop would be contacting DP.
     
    kynast, Jun 2, 2006 IP
  18. mavahntooth

    mavahntooth Well-Known Member

    Messages:
    1,064
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    128
    #18
    goodluck to your search engine! :D
     
    mavahntooth, Jun 2, 2006 IP
  19. benzing

    benzing Guest

    Messages:
    27
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #19
    good luck.......
     
    benzing, Jun 3, 2006 IP
  20. Rage

    Rage Well-Known Member

    Messages:
    3,062
    Likes Received:
    122
    Best Answers:
    0
    Trophy Points:
    190
    #20
    yes... i dont know anything abot programing.. thats why i am asking you... can you please tell me know :rolleyes:
     
    Rage, Jun 3, 2006 IP