Social Buttons
  1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Trying to dump 143 MB

Discussion in 'MySQL' started by aaron_nimocks, Mar 15, 2006.

0
  1. #1
    Having trouble dumping 143 MB file into phpmyadmin. It says it can only do 10 MB files so I would have to split it up into 15 files. But it takes forever to copy and paste with 2.5 million lines of data.

    Does anyone know any easy way to get this data into my database?
     
    aaron_nimocks, Mar 15, 2006 IP
  2. TheHoff

    TheHoff Peon

    Messages:
    1,530
    Likes Received:
    130
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Without SSH access?
     
    TheHoff, Mar 15, 2006 IP
  3. aaron_nimocks

    aaron_nimocks Im kind of a big deal Staff

    Messages:
    5,563
    Likes Received:
    627
    Best Answers:
    0
    Trophy Points:
    420
    #3
    Not sure what SSH access is. I just log into phpadmin and try it.
     
    aaron_nimocks, Mar 15, 2006 IP
  4. TheHoff

    TheHoff Peon

    Messages:
    1,530
    Likes Received:
    130
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Can you get a shell prompt? In your Cpanel see if you have the option of SSH or Shell access. If so, you can do imports/exports the easy way...

    mysqldump and mysql <


    edit: or it may just be faster to call your hosting company, tell them where the data file is, and let them run the import command.. otherwise you are stuck with breaking it up. I've seen someone around here claim to have a PHP script that will import larger files, but it will still timeout I think unless you have the ability to modify the ini timeout values.
     
    TheHoff, Mar 15, 2006 IP
  5. mdvaldosta

    mdvaldosta Peon

    Messages:
    4,079
    Likes Received:
    362
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Shell (usually only given to the root account) access would allow you to use commands to transfer the file from one server account to another (really fast).
     
    mdvaldosta, Mar 15, 2006 IP
  6. aaron_nimocks

    aaron_nimocks Im kind of a big deal Staff

    Messages:
    5,563
    Likes Received:
    627
    Best Answers:
    0
    Trophy Points:
    420
    #6
    Ill check but I dont think I have it, I am using dreamhost.
     
    aaron_nimocks, Mar 15, 2006 IP
  7. mdvaldosta

    mdvaldosta Peon

    Messages:
    4,079
    Likes Received:
    362
    Best Answers:
    0
    Trophy Points:
    0
    #7
    If your on a shared hosting account you won't be able to use SSH, 99.999% of the hosts don't allow it unless you're on a VPS or dedicated box. Maybe you could ask your host to do the transfer for you, it could be done in just a few seconds - whereas it'd take you hours.
     
    mdvaldosta, Mar 15, 2006 IP
  8. l234244

    l234244 Peon

    Messages:
    1,225
    Likes Received:
    50
    Best Answers:
    0
    Trophy Points:
    0
    #8
    If you upload the sql file to the server and give me ftp/mysql details I can do it with a parser I have
     
    l234244, Mar 15, 2006 IP
    aaron_nimocks likes this.
  9. dct

    dct Finder of cool gadgets

    Messages:
    3,132
    Likes Received:
    328
    Best Answers:
    0
    Trophy Points:
    230
    #9
    You could connect remotely using something like MySQL Query Browser or SQLyog
     
    dct, Mar 15, 2006 IP
  10. roseplant

    roseplant Peon

    Messages:
    253
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #10
    have you tried gzipping it? if it's plaintext you just might get it to compress small enough.
     
    roseplant, Mar 15, 2006 IP
  11. aaron_nimocks

    aaron_nimocks Im kind of a big deal Staff

    Messages:
    5,563
    Likes Received:
    627
    Best Answers:
    0
    Trophy Points:
    420
    #11
    I havent because I dont have anything to try it but I dont know if it would get that small.
     
    aaron_nimocks, Mar 15, 2006 IP
  12. roseplant

    roseplant Peon

    Messages:
    253
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #12
    You'd be surprised how tightly plaintext can compress. I think Winzip can save as *.gz, but I'm not sure. I use WinRAR which definately can save as gzip. You can download a trial here:
    http://www.download.com/3000-2250-10007677.html

    Just looking at my phpmyadmin it says the limit is 51,200kb. Different version I guess.
     
    roseplant, Mar 15, 2006 IP
  13. Momo

    Momo Peon

    Messages:
    965
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Momo, Mar 15, 2006 IP
  14. aaron_nimocks

    aaron_nimocks Im kind of a big deal Staff

    Messages:
    5,563
    Likes Received:
    627
    Best Answers:
    0
    Trophy Points:
    420
    #14
    Thanks to all. I got it in though. Well l234244 did it for me. :)
     
    aaron_nimocks, Mar 15, 2006 IP
  15. EGS

    EGS Notable Member

    Messages:
    6,078
    Likes Received:
    438
    Best Answers:
    0
    Trophy Points:
    290
    #15
    Usually you should do that big of files through Shell if you ask me! But at least you got the job done! :D
     
    EGS, Mar 15, 2006 IP
  16. photoads

    photoads Well-Known Member

    Messages:
    1,027
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    130
    #16
    Agree the guy who created this script is a genious! The script imports records in rows of whatever you choose in the config. This script is a stress saver
     
    photoads, Mar 22, 2006 IP
  17. iBold

    iBold Peon

    Messages:
    1,055
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Not to get to far off topic, but I've wondered about this as well.
    Say I'm running cpanel and I want to use shell to get a DB in place. I upload the zipped up DB to the root of the users account, what commands would I use to actually extract it to mySQL? Any kind of example would be great :)
     
    iBold, Mar 22, 2006 IP
  18. exam

    exam Peon

    Messages:
    2,434
    Likes Received:
    120
    Best Answers:
    0
    Trophy Points:
    0
    #18
    I know this is already taken care of, but just for the record, Dreamhost allows SSH access for shared servers. You should be able to upload the file via FTP and then log into the server with Putty and import with Mysql's command line tools.
     
    exam, Mar 22, 2006 IP