How to store the data properly

Discussion in 'MySQL' started by stephan2307, Aug 9, 2011.

  1. #1
    I am working on an application which will record around 95Million records per year. Now I am trying to find out how the data needs to be stored to achieve best performance.

    I was thinking instead of pushing 95Million records in the same table to create a db for every month and then a table per day. that way there are only about 280k entries per table.

    data is not alot. there are only 8 columns per table and data from one day does not need to be compared with data of another day.

    Does the above make sense?
     
    stephan2307, Aug 9, 2011 IP
  2. mwasif

    mwasif Active Member

    Messages:
    816
    Likes Received:
    23
    Best Answers:
    1
    Trophy Points:
    70
    #2
    mwasif, Aug 9, 2011 IP
  3. pacifich

    pacifich Guest

    Messages:
    101
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I think that is not a problem to store them. In any case your problem will be streaming and downloading such data from the server.
     
    pacifich, Aug 16, 2011 IP
  4. Rukbat

    Rukbat Well-Known Member

    Messages:
    2,908
    Likes Received:
    37
    Best Answers:
    51
    Trophy Points:
    125
    #4
    MySQL can handle a table that size. Just make sure you index on what you need to find. A linear search through a table that size is something you start when you go home on Friday if you need the results on Monday. (And remember, "LIKE" is a linear search.)
     
    Rukbat, Aug 24, 2011 IP
  5. freelanceinphp

    freelanceinphp Member

    Messages:
    134
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    48
    #5
    portioning is good option to manage huge db.
     
    freelanceinphp, Aug 25, 2011 IP
  6. tedmosbey

    tedmosbey Peon

    Messages:
    13
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    you can use microsoft sql to store data.
    list out all the data types you would like to store
    create a table using create table command
    u can also read Relational database concepts to understand better
     
    tedmosbey, Aug 26, 2011 IP
  7. mmerlinn

    mmerlinn Prominent Member

    Messages:
    3,197
    Likes Received:
    819
    Best Answers:
    7
    Trophy Points:
    320
    #7
    You say you want to store data to get the best performance. That is meaningless. Best performance doing WHAT? Adding records? Deleting records? Updating records? Accessing records? Or what?

    What do you mean by best performance? How are you using the collected data? How are you accessing it?
     
    mmerlinn, Aug 28, 2011 IP