Making a search engine!

Discussion in 'All Other Search Engines' started by oliveskate, Oct 15, 2007.

  1. #1
    I might be interested in making a search engine, but I got a few questions that need to be answerd.

    How much bandwith would you use monthy/ daily etc... Would 2TB be enough or way to less.

    Does it take a lot of diskspace as well?

    Where can I get a script for a search engine.
    Free or Paid.

    All the questions I got for now, hope to get them answered.
    Sorry if it's in the wrong section.
     
    oliveskate, Oct 15, 2007 IP
  2. Dishin Nutrition

    Dishin Nutrition Banned

    Messages:
    199
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #2
    2TB a year is enough if you have that many visitors. 90% of sites don't use more than 10 GBs of bandwidth.
     
    Dishin Nutrition, Oct 15, 2007 IP
  3. oliveskate

    oliveskate Banned

    Messages:
    134
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    wow ok. Thanks :)
     
    oliveskate, Oct 15, 2007 IP
  4. Dishin Nutrition

    Dishin Nutrition Banned

    Messages:
    199
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #4
    And, don't forget, you can always upgrade.
     
    Dishin Nutrition, Oct 15, 2007 IP
  5. oliveskate

    oliveskate Banned

    Messages:
    134
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Yeah. Ok thanks. You know any good scripts as well?
     
    oliveskate, Oct 15, 2007 IP
  6. skillipedia

    skillipedia Well-Known Member

    Messages:
    623
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    110
    #6
    You should be familar with the source code of your search engine. Nobody make search engines. you may find open source bots - most of them use Java Lucene for indexing and searching, but it's not for the faint- hearted

    It's a very big idea that needs many brains - not just one

    Good luck any way
     
    skillipedia, Oct 15, 2007 IP
  7. dopiitv

    dopiitv Well-Known Member

    Messages:
    1,556
    Likes Received:
    51
    Best Answers:
    0
    Trophy Points:
    165
    #7
    PMed you a lil sumthin sumthin :)
     
    dopiitv, Oct 15, 2007 IP
  8. oliveskate

    oliveskate Banned

    Messages:
    134
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Got it, thanks man :)
     
    oliveskate, Oct 15, 2007 IP
  9. Absolutus

    Absolutus Peon

    Messages:
    233
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Absolutus, Oct 15, 2007 IP
  10. firmaterra

    firmaterra Peon

    Messages:
    756
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #10
    If you're talking about crawling the web and downloading the files with your own search engine you'll find 2TB gone very fast indeed. If all your doing is serving results from an existing search engine, 2TB is loads! Do a search for nutch. Its probably the most comprehnsive search engine script around, for free :D

    As for diskspace, if your keeping a cache to serve, you'll find yourself pushed for any kind of decent index with anything under 6TB. Depends how you crunch and compress the data.
     
    firmaterra, Oct 15, 2007 IP
  11. oliveskate

    oliveskate Banned

    Messages:
    134
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Thanks for the info.Yes I'll problably take info, from google, yahoo and other search engines. But thanks again, I appreciate it, everybody!
     
    oliveskate, Oct 15, 2007 IP