3.7 Million Pages - MYSQL DB Import & Optimization

Discussion in 'MySQL' started by space101, Jan 2, 2009.

0
  1. #1
    Hi all,

    I have this HUGE Db thats 600MB large, 3.7 million records and I need help getting it completely imported and optimized as I have it now it looks like some of the script is not getting uploaded, because I believe it's starting to list single records of the MYSQL DB.

    It takes probably 2-3 mintues to load and I'm on a VPS server. So even if the DB did get fully loaded it's taking entirely too long for the site to load.

    Any suggestions or ideas as to how to get this too work properly, I know it's possible I'm not a MYSQL guru.

    Any help is appreciated.

    Thanks
     
    space101, Jan 2, 2009 IP
  2. LeftoverSoup

    LeftoverSoup Guest

    Messages:
    95
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Well to work this out we are going to need to know what your site is? Forum? Link Directory? Video Site? Other?

    You could probably hire a programmer to fix this for you. To make the script pull a certian number of results from the MySQL database, or divide the results into separate pages.
     
    LeftoverSoup, Jan 2, 2009 IP
  3. space101

    space101 Peon

    Messages:
    161
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    www.businesscalifornia.net

    Let me warn you it takes a while to load up so give it a few minutes. :(
    I just tried reuploading the DB and instead of the 900MB it was when it was uploaded last time it's now 500MB. This is really crazy.

    Thanks
     
    space101, Jan 2, 2009 IP
  4. jupapa

    jupapa Peon

    Messages:
    205
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    jupapa, Jan 2, 2009 IP
  5. JWRmedia

    JWRmedia Banned

    Messages:
    499
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Why not download one table at a time as an .sql file, then you can open each .sql file and manually break it into smaller .sql files for uploading.

    Sure it will take forever, but it should work- Ive done it before.
     
    JWRmedia, Jan 2, 2009 IP
  6. space101

    space101 Peon

    Messages:
    161
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Anybody willing to give me a quote to get this taken care of?
     
    space101, Jan 2, 2009 IP
  7. kwijibo

    kwijibo Peon

    Messages:
    14
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    what version of mysql do you have on your server?
     
    kwijibo, Jan 2, 2009 IP
  8. shacow

    shacow Active Member

    Messages:
    339
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    60
    #8
    I can do it for you, do you have the database in one sql file and do you have ssh access to the vps?
     
    shacow, Jan 2, 2009 IP
  9. mwasif

    mwasif Active Member

    Messages:
    816
    Likes Received:
    23
    Best Answers:
    1
    Trophy Points:
    70
    #9
    Let me know if you are still looking for someone
     
    mwasif, Jan 3, 2009 IP
  10. mwasif

    mwasif Active Member

    Messages:
    816
    Likes Received:
    23
    Best Answers:
    1
    Trophy Points:
    70
    #10
    It looks like you are displaying 3.7 million records on the home page. Isn't it?
     
    mwasif, Jan 3, 2009 IP
  11. space101

    space101 Peon

    Messages:
    161
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Yea I figured out that the DB is totally screwed because I uploaded another DB to another site and it's much better.

    2+Million records and it loads better now that I enabled MYSQL query_cache and thats much better now.

    Thanks all.
     
    space101, Jan 4, 2009 IP
  12. SEOAnalytic.com

    SEOAnalytic.com Member

    Messages:
    106
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #12
    Delete the overhead if exists.

    Do you use a MySQL administration centre such as PHPMyADMIN, MySQL Quick ADmin ?
     
    SEOAnalytic.com, Jan 4, 2009 IP
  13. space101

    space101 Peon

    Messages:
    161
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #13
    I use PHPmyadmin how do i delete the overhead?
     
    space101, Jan 5, 2009 IP