I had written an article a while back on moving large sites that I just realized I never published... Here's the link: Overcoming the 2GB file limit in Linux when moving your sites I figured it would be helpful to those of you who run large content sites. If you have any questions, go ahead and post them on my blog and I'll respond accordingly. Feel free to subscribe as well. I'm going to start taking my blog more seriously as the traffic has picked up a decent amount with this last update. Inbetween regular work I'll be posting a Tips for Productivity series. If you have an article or tips that help you stay productive, I would love to have some guest-writers as well. Proper credit and a back-link to your blog/site will be given if you have one as well.
Silly tutorial If you have shell access to both accounts why are you using wget and having the files public accessible? Just archive it then use scp. You could still split it if you like but wget 2GB limit really shouldn't be an issue considering it's a bad idea to be transferring it via wget.
Its good for newbies who don't know about scp, but it'd be nice if you could use that as thats secure transfer between servers. noobs would learn that as well
Mainly because I have issues using scp (or rsync for that matter) on one of the servers I'm moving away from and needed another solution which is when I ran by this one. I didn't say it was the best way, I simply offered an alternative and hopefully some insight for people new to linux on commands they might not know yet. Nothing more. Nothing less. Cheers for your input though.
I know this is a lazy solution, but because I use Plesk on every server I have the easiest way for me to move any site is simply to go through the migration wizard on the new server. It's painless and 95% of the time I have no issues. Every now and then I'll have a problem transferring huge databases, but for the most part it's fairly reliable. I've used rsync in the past and it's treated well, but one of the reasons I'm moving from the hosting company that prompted me to make the article is that I can neither use scp or rsync on them which made me come up with this solution...