Best Database for handling Billions of data

Discussion in 'MySQL' started by sqldba, Feb 12, 2008.

  1. #1
    Hi,

    I am working in Trade enivornment and i have experience only on SQL 2000.

    Each day approximately 4 million data gets loaded and transactions being happened in my server.

    Please let me know which database(Sql/Oracle/Sybase/Informix..) can i use for high performance with free or one license.

    I am looking for a database which is having high speed in retrieving large data and having massive storage with no performance issues.

    Some suggested me to use Informix, but still im doing a R&D work on it.

    Please suggest me with two or three different datases with their high performance features.

    Thanks in advance
     
    sqldba, Feb 12, 2008 IP
  2. bluegrass special

    bluegrass special Peon

    Messages:
    790
    Likes Received:
    50
    Best Answers:
    0
    Trophy Points:
    0
    #2
    MySQL is good enough for Google and they process more data than you. MSSQL is also good, but costs a pretty penny (though there is a free version, I'm not sure how it does with large data sets). Oracle is good, but not always better than MSSQL in features and it is very expensive.
     
    bluegrass special, Feb 12, 2008 IP
  3. TipTheCow

    TipTheCow Peon

    Messages:
    29
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Just from experience, SQL 2005 or Oracle (don't remember what the new ver is) would both be sufficient. Their expensive, but work well.
     
    TipTheCow, Feb 12, 2008 IP
  4. AstarothSolutions

    AstarothSolutions Peon

    Messages:
    2,680
    Likes Received:
    77
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Your talking of operations on this scale but you want free?

    Your doing development on informix on someones suggestion but already looking for an alternative?

    The three normal commercial sql servers would be MS SQL Server, Oracle and DB2. You dont mention what purpose the db is (production, archive, datawarehouse etc).... if it is datawarehouse then DB2 or Oracle have some very strong tools built in. If it is production then MS SQL (or Oracle) is probably the stronger contender
     
    AstarothSolutions, Feb 13, 2008 IP
  5. scielens

    scielens Peon

    Messages:
    44
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    well... you really do get what you pay for... :)
     
    scielens, Feb 14, 2008 IP
  6. LinketySplit

    LinketySplit Peon

    Messages:
    97
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Oracle has the most features for managing large databases. SQL Server & Oracle both have "lite" versions you can download and use for free, but unfortunately (and what sounds to be a show-stopper for your requirements) they have licensing restrictions on the size of your database and the max number of CPUs and RAM that are allowed to be used by the engine.

    It can be done with open source DBMSs too.

    Best of luck on your journey!
     
    LinketySplit, Feb 17, 2008 IP
  7. Petey

    Petey Peon

    Messages:
    68
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Hi sqldba,

    If you are on a windows platform then nothing beats SQL Server. On *nix I would choose Informix over Oracle or DB2.

    You can go a long way with MySQL but you have to put in the effort on the physical database design. Use table partitioning for your largest tables and spread the partitions across many physical disk drives if possible. Add as much memory as possible and tune up your queries so they can be cached.

    If you do win the lottery then check out the database performance benchmarks at the Transaction Performance Processing Council http://www.tpc.org/ .
     
    Petey, Feb 19, 2008 IP
  8. northwest

    northwest Peon

    Messages:
    277
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #8
    I am a computer consultant with experience in this. If money is not an objective, go with Oracle. I have been an Oracle DBA and I have also worked on MYSQL, SQL Server and Sybase; also, I have been an Oracle architect. MYSQL is good for smaller data sets so let's rule this out as we are talking about billions of data. For OS, Unix is excellent for such large datasets. With windows and SQL Server, such large dataset will run into issues.

    If you are looking for the best, nothing beats Unix - Oracle combo for large data sets. In fact, just last month I got off a project which had 3 billion records; the Unix - Oracle Combo never broke...
     
    northwest, Feb 20, 2008 IP
  9. LittleJonSupportSite

    LittleJonSupportSite Peon

    Messages:
    386
    Likes Received:
    20
    Best Answers:
    0
    Trophy Points:
    0
    #9
    I would go MSSQL and pay for support as well.
     
    LittleJonSupportSite, Feb 20, 2008 IP