Server to Server file transfer

Discussion in 'Site & Server Administration' started by Junije, Apr 11, 2009.

  1. #1
    Hi,

    In the near future I will have to make a transfer of files onto my server. So, the problem lies here, my upload speed is 25KBps and all the files I need to upload to my server are about 50GB. (Those files lie on many servers on the internet and can be downloaded freely). Now, with my upload speed it would take app. 277 hours and that is somewhat too much for me, as I would need those files on the server ASAP. So what I want to know, is there a way to download files directly from one server to another, instead of downloading from a server to my pc, and then uploading from pc to my server?
     
    Junije, Apr 11, 2009 IP
  2. sarsh11

    sarsh11 Active Member

    Messages:
    959
    Likes Received:
    28
    Best Answers:
    0
    Trophy Points:
    70
    #2
    sarsh11, Apr 11, 2009 IP
  3. bucasia

    bucasia Peon

    Messages:
    50
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    It depends what access you have to the 2 servers. It's certainly possible if you have ssh access (to at least one of them)

    Check out the rsync and wget commands. Either you could use in different circumstances.
     
    bucasia, Apr 11, 2009 IP
  4. Junije

    Junije Well-Known Member

    Messages:
    136
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    103
    #4
    Thanks! The servers are dedicated and will have SSH access. Now, I will look up this "rsync" and "wget" commands to get familiar with them.
     
    Junije, Apr 11, 2009 IP
  5. bucasia

    bucasia Peon

    Messages:
    50
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Cool. If you've got ssh access to both then I'd look at rsync. It will allow you to restart the transfer should it get interrupted for any reason. Also, it runs over ssh so is secure.
     
    bucasia, Apr 11, 2009 IP
  6. tera

    tera Peon

    Messages:
    159
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Oh my god do you have ssh access and u dont know how to transfer files between two machines connected to internet?
     
    tera, Apr 11, 2009 IP
  7. Junije

    Junije Well-Known Member

    Messages:
    136
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    103
    #7
    LOL. I don't have it now, but will soon :)
    I never worked with dedicated servers so this question just popped on my mind the otherday, and had to post it here to get things straight.
     
    Junije, Apr 12, 2009 IP
  8. kailash

    kailash Well-Known Member

    Messages:
    1,248
    Likes Received:
    42
    Best Answers:
    0
    Trophy Points:
    190
    #8
    I suggest to use rsync. Just follow the below steps:

    - Create a key on new server and save this key on old server and then use following command:

    /root/kailash/ssh_key = Path of key file of new server on old server
    2222 = Replace this with port which you are using for SSH on remote server
    /backups = Replace with folder which you want to move to new server
    REMOTE_USER = SSH user of your new server
    IP_ADDRESS = New server IP address
    /home/newlocation/ = Where you want to move data
     
    kailash, Apr 12, 2009 IP
  9. CrumX

    CrumX Banned

    Messages:
    326
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #9
    there is a script called rapidleech out there... if you dont know how to use wget then this might be suitable for you..
     
    CrumX, Apr 13, 2009 IP
  10. Bohra

    Bohra Prominent Member

    Messages:
    12,573
    Likes Received:
    537
    Best Answers:
    0
    Trophy Points:
    310
    #10
    If u have ssh use the command wget
     
    Bohra, Apr 13, 2009 IP
  11. LiMoO

    LiMoO Well-Known Member

    Messages:
    161
    Likes Received:
    0
    Best Answers:
    1
    Trophy Points:
    133
  12. baonhi41

    baonhi41 Peon

    Messages:
    141
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    You can use this tool: http://admindiscuss.com/forum/showthread.php?tid=1
    It saves your time. Very fast.
     
    baonhi41, Jul 15, 2009 IP
  13. Sheikh Ahsan

    Sheikh Ahsan Peon

    Messages:
    101
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #13
    I have never thought about this way..anyways what baonhi41 has written sounds kool. Just try this one!

    Cheers!
     
    Sheikh Ahsan, Jul 15, 2009 IP