1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

how to open a very large csv file

Discussion in 'Databases' started by superuser101, Oct 31, 2013.

  1. #1
    Hello,

    I need some help to open a 16gb csv file, how much RAM or CPU do i need in my pc to open it? Thank you !!
    SEMrush
     
    superuser101, Oct 31, 2013 IP
    SEMrush
  2. ZyreX

    ZyreX Active Member

    Messages:
    104
    Likes Received:
    13
    Best Answers:
    1
    Trophy Points:
    90
    #2
    Try these 2 programs: UltraEdit and EmEditor

    User Comment:
     
    ZyreX, Oct 31, 2013 IP
  3. OwnCoder

    OwnCoder Greenhorn

    Messages:
    26
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #3
    You can try on NotePad++
     
    OwnCoder, Oct 31, 2013 IP
  4. cameronpalte

    cameronpalte Active Member

    Messages:
    672
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    65
    #4
    Or you could try kiwix. 16gb is too large for Notepad ++ because it wouldn't work for my downloaded wikipedia copy (10gb), but kiwix did. Though I'm not sure if kiwix supports all files.
     
    cameronpalte, Oct 31, 2013 IP
  5. kutchbhi

    kutchbhi Active Member

    Messages:
    130
    Likes Received:
    4
    Best Answers:
    2
    Trophy Points:
    70
    #5
    depending upon your requirements , you could also use command line tools to do the job. like grep
     
    kutchbhi, Nov 12, 2013 IP
  6. Dot_Net

    Dot_Net Greenhorn

    Messages:
    30
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    23
    #6
    I'm assuming that you're on Windows, so I'll recommend gVim. Where Notepad++ will choke on very large files, VIM has chowed through those puppies with little problem.
     
    Dot_Net, Nov 13, 2013 IP
  7. nextsmm

    nextsmm Greenhorn

    Messages:
    47
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    8
    #7
    There is a solution in Excel. You can’t open big files in a standard way, but you can create a connection to a CSV file. This works by loading data into Data Model, keeping a link to the original CSV file. This will allow you to load millions of rows.
     
    nextsmm, Feb 14, 2022 IP
    JEET likes this.
  8. Daniel165

    Daniel165 Greenhorn

    Messages:
    65
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    18
    #8
    You can try Notepad++ and Subline text.
     
    Daniel165, Jul 6, 2022 IP
  9. AquaSwitch

    AquaSwitch Peon

    Messages:
    9
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    1
    #9
    I would recommend Looker as the solution for datasets larger than old excel can cope with.
     
    AquaSwitch, Jul 6, 2022 IP