1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Anyone know an FTP client that can handle masses of files?

Discussion in 'Products & Tools' started by Paulie, Nov 21, 2009.

  1. #1
    I started using filezilla until it refused to show me all my files....

    I then started using WinSCP however i have one folder which contains over 90,000 files (small ones) prob is, every time i try to open the folder to access the files the ftp client dies :confused:

    Any recommendations?
     
    Paulie, Nov 21, 2009 IP
  2. lcwadminbj

    lcwadminbj Peon

    Messages:
    402
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #2
    personally I use ws_ftp pro from ipswitch.com.

    If it will handle that many files I dont know but I find it fast and efficient for all my FTP work.

    The have a good support desk so you could contact tem and ask.
    You can also get an evaluation download.

    I have been using it for several years now and can recommend its use.
     
    lcwadminbj, Nov 25, 2009 IP
  3. zgerm

    zgerm Peon

    Messages:
    584
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I using Filezilla and it seems no problem for me..it works great for uploading files
     
    zgerm, Nov 25, 2009 IP
  4. Ibn Juferi

    Ibn Juferi Prominent Member

    Messages:
    6,221
    Likes Received:
    365
    Best Answers:
    0
    Trophy Points:
    310
    #4
    I would recommend FileZilla for the kind of thing you are asking for :)
     
    Ibn Juferi, Nov 25, 2009 IP
  5. Paulie

    Paulie Active Member

    Messages:
    749
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    81
    #5
    Ive already written that filezilla will not cope. have you read my Original post?
     
    Paulie, Nov 26, 2009 IP
  6. Neon

    Neon Peon

    Messages:
    144
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Split the folder into smaller amounts of files, for example the current folder has 90k files, so make 10 new folders with 9k files each, then upload 1 folder at a time and it should work without any problems, much easier then running around trying to find a decent FTP application aside from FileZilla.
     
    Neon, Nov 26, 2009 IP
  7. Paulie

    Paulie Active Member

    Messages:
    749
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    81
    #7
    I cant, i cant get into the folder that has all the files to split them in the first place. As soon as i attempt to access the folder (which content is saved to automatically) it crashes
     
    Paulie, Nov 26, 2009 IP
  8. bille

    bille Peon

    Messages:
    269
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #8
    you may need to use a command line ftp client to get past this issue. Either the built-in windows client, or the one that comes with cygwin.
     
    bille, Nov 26, 2009 IP
  9. Paulie

    Paulie Active Member

    Messages:
    749
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    81
    #9
    hmm wish i knew what you meant lol

    Will google it......
     
    Paulie, Nov 26, 2009 IP
  10. x997

    x997 Peon

    Messages:
    13
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    mabe you have SSH access?

    or try Total Commander (works slowly, but stable)
     
    x997, Nov 26, 2009 IP
  11. Archimonde

    Archimonde Peon

    Messages:
    72
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    You can use FlashFTP. It's very good for you.
     
    Archimonde, Nov 26, 2009 IP
  12. xoise

    xoise Active Member

    Messages:
    665
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    95
    #12
    Zip or tar/gzip the file, upload it, then decompress it.

    I use WinSCP for the record.
     
    xoise, Nov 27, 2009 IP
  13. lcwadminbj

    lcwadminbj Peon

    Messages:
    402
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #13
    On re reading this post I have a new question for you .
    Is your sever linux/unix?
    if do the maximum number of files you can have in a folder is about 1995, so you will have to split things up.

    You could use your windows explorer on your pc to create seperate folders and then move files into them.
     
    lcwadminbj, Nov 27, 2009 IP
  14. xoise

    xoise Active Member

    Messages:
    665
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    95
    #14
    This is actually incorrect. There is no limit to the number of files you can have in a directory. However, many commands, such as rm, dir, ls, etc. can only handle so many files. It is usually best to set up an appropriate directory tree to store the files though.
     
    xoise, Nov 27, 2009 IP
  15. lcwadminbj

    lcwadminbj Peon

    Messages:
    402
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #15
    I refer to it being limited as there is no point in having files in the folder on the server that you cant see when you ftp in.
    it makes it impossible to keep track of what you are doing.
    I should have been a little clearer.
     
    lcwadminbj, Nov 29, 2009 IP
  16. Paulie

    Paulie Active Member

    Messages:
    749
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    81
    #16
    *hmmm all over my head this is*
     
    Paulie, Nov 29, 2009 IP
  17. xoise

    xoise Active Member

    Messages:
    665
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    95
    #17
    You're correct to a point, but there are times when it's not necessary to traverse a directory with FTP/SSH. For instance, I've create some file-system caching before that generated files on the fly for a dynamic site. The file name is just a key of some sort and the script knows exactly what file to look for.

    Sorry to be petty, just speaking from experience. :)
     
    xoise, Nov 29, 2009 IP
  18. rishabhverma

    rishabhverma Peon

    Messages:
    22
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #18
    I am using SmartFTP //http://www.smartftp.com/ which is great tool and has not given me any problems even with a huge number of files and has not given me any problems yet.
     
    rishabhverma, Nov 30, 2009 IP
  19. Paulie

    Paulie Active Member

    Messages:
    749
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    81
    #19
    Cheers for the suggestion....

    Though that wont even show the files in question if that makes sense
     
    Paulie, Nov 30, 2009 IP
  20. sarahk

    sarahk iTamer Staff

    Messages:
    28,500
    Likes Received:
    4,460
    Best Answers:
    123
    Trophy Points:
    665
    #20
    I used smartftp until I got sick of the licensing model and reverted to filezilla - both are equally good at handling huge uploads (and downloads).
     
    sarahk, Nov 30, 2009 IP