server migration, help plz

Discussion in 'Site & Server Administration' started by toby, Sep 18, 2007.

  1. #1
    Hello guys,

    I'm moving server from hostgator to softlayer . And right now i'm stuck with how to move ALL site data over and have a good migration.

    someone recommend rsync. But how to use it? can i do a sever to server migration without downloading all server data to my pc first (100GB for god's sake!)

    then how can i change the name server thingy?
     
    toby, Sep 18, 2007 IP
  2. tandac

    tandac Active Member

    Messages:
    337
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    58
    #2
    You can go from server to server with rsync. I suspect the bandwidth fees for rsyncing 100GB of data would be rather pricey.

    Changing the name servers is no different than any other time...
     
    tandac, Sep 18, 2007 IP
    toby likes this.
  3. toby

    toby Notable Member

    Messages:
    6,923
    Likes Received:
    269
    Best Answers:
    0
    Trophy Points:
    285
    #3
    what do you mean rsyncing of Bandwidth is pricey? I am not syaing of downloading it to my pc first.

    What do i have to do to get rsyncing working? upload rsycn to both server?
     
    toby, Sep 18, 2007 IP
  4. cyanide

    cyanide Peon

    Messages:
    483
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Lots of questions, here my friend...

    What control panel?
    Are both these dedicated servers? If not, please explain
    How many domains total?
    Are there multiple reseller-type accounts?
    Or is it many domains under one main account?
    Do you have your own nameservers?

    this is a start...
     
    cyanide, Sep 18, 2007 IP
  5. toby

    toby Notable Member

    Messages:
    6,923
    Likes Received:
    269
    Best Answers:
    0
    Trophy Points:
    285
    #5
    i use, Cpanel
    Only 2 sites but BIG (100GB of space)
    No reseller
    got Cron
    what u mean by nameserver? I have my own i.e. ns1.mydomain.com ns2.mydomain.com if that's what u mean.

    how can i use rsync?
    toby
     
    toby, Sep 19, 2007 IP
  6. cyanide

    cyanide Peon

    Messages:
    483
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    0
    #6
    You didn't answer this one :)
     
    cyanide, Sep 19, 2007 IP
  7. toby

    toby Notable Member

    Messages:
    6,923
    Likes Received:
    269
    Best Answers:
    0
    Trophy Points:
    285
    #7
    both are dedicated.
     
    toby, Sep 19, 2007 IP
  8. owsolution

    owsolution Well-Known Member

    Messages:
    290
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    138
    #8
    owsolution, Sep 19, 2007 IP
  9. cyanide

    cyanide Peon

    Messages:
    483
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Do you have databases? How big?

    Alrighty, here's what I would do. cPanel and dedicated makes it easier.

    You have root access, so log into the old server, and run
    I'm assuming you have databases, so this command optimizes them, which i recommend.

    Once it's done, then run
    Replace username with the actual username of the 1st domain.
    This will package up the domain and all it's files/databases/emails, everything.

    This will take some time. Once it is done you will have a file called cpmove-username.tar.gz in the /home folder
    Now run these 2
    This just changes permissions from root to username
    Now run
    This moves the file to an accessible area.

    Then log into the new server as root, and run
    The first line moves you into the /home directory, the second line copies the file from the old server to the new one.

    Once that's complete log into WHM as root in the new server, and click Restore a Full Backup/cpmove file
    You should see the cpmove file. Just type in the username of this account and click Restore. This will take some time, but when done, it will be completely installed on the new server. You will have to do some further minor configuration, such as assigning the new ip addresses to this domain and your nameservers.

    Now repeat for second domain.

    Hope I didn't forget anything. :)
     
    cyanide, Sep 19, 2007 IP
  10. toby

    toby Notable Member

    Messages:
    6,923
    Likes Received:
    269
    Best Answers:
    0
    Trophy Points:
    285
    #10
    thanks cyan, the problem may be because the whole things is SO big: 100GB of space.

    Wonder if i can use rsync? or anyone has use rsync?

    Another problem is that the old server has many users visiting daily and uploading video often too.
    daily there are around 5 - 10 new visitors so if i do like cyan mentioned, i may lose some users..
     
    toby, Sep 19, 2007 IP
  11. LevelServe

    LevelServe Guest

    Messages:
    11
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    If you have root on both, rsync is not the best option. I would tar up the files and ftp between them. There is a company called servermins that will do this stuff for you, but they charge like $60 an hour.
     
    LevelServe, Sep 19, 2007 IP
  12. cyanide

    cyanide Peon

    Messages:
    483
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Well, yes moving a busy site is tricky, no doubt about it.
    But, it can be done with some planning.

    When people upload videos where does it go? A Folder or database?
    Is there anything else that gets updated, besides videos?
    Do you have a forum?
     
    cyanide, Sep 19, 2007 IP
  13. rederick

    rederick Peon

    Messages:
    128
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #13
    If you have root access and Cpanel/WHM on both servers - There is a move account feature that I've used before that worked pretty slick. You just need to login to WHM on the server you are moving the sites to then go to the "Transfers" page.

    When moving servers it's pretty hard to avoid at least some downtime or strangeness. I recommend lowering the TTLS on the domain when you are ready to change the DNS it'll take less time to propigate.
     
    rederick, Sep 19, 2007 IP
  14. toby

    toby Notable Member

    Messages:
    6,923
    Likes Received:
    269
    Best Answers:
    0
    Trophy Points:
    285
    #14
    no i dont have any forums yet.
    So rsync is not an option. and cyan, how long your method would take? 2 days just to back everything up?

    rederick, so ur method is pretty straigh forwards, does it take into account the Cron, Database etc?
     
    toby, Sep 20, 2007 IP
  15. hostmellow

    hostmellow Peon

    Messages:
    31
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    Toby, see, i think you should try making the full backup from hostgator cpanel, and then download it using shell in your new dedicated server instead of the conventional restore function from WHM. Whats the profit of this is it wont stuck memory hogging as shell wget wont use enough for that. While doing the restoration using whm it might stuck anytime for hogging. Make sure you download the file in /home directory, either you need to face another hectic situation to move the file to /home :)

    After downloading it just run /scripts/restorepkg username to restore it, for 100GB this process shouldn't take more then 10-12 hours i expect if godaddy allows to you download the file at more then 512 KBps speed. I m also expecting your dedi box got a 10Mbps (Least) pipe line.


    Isn't his old server hostgator? :) Its a shared hosting provider ;)
     
    hostmellow, Sep 20, 2007 IP
  16. cyanide

    cyanide Peon

    Messages:
    483
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    0
    #16
    One day, I would say. Alot of this transfer will depend on what part of your site gets updated, as mentioned earlier.

     
    cyanide, Sep 20, 2007 IP
    toby likes this.
  17. rederick

    rederick Peon

    Messages:
    128
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Yes - I am pretty sure it transfered the entire account over to the new server - email addresses and all.
     
    rederick, Sep 20, 2007 IP
  18. rederick

    rederick Peon

    Messages:
    128
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #18
    However - I think cyanide's method above will probably be your best bet for such a large account.

    Something I found on the cpanel forum
     
    rederick, Sep 20, 2007 IP
    toby likes this.
  19. toby

    toby Notable Member

    Messages:
    6,923
    Likes Received:
    269
    Best Answers:
    0
    Trophy Points:
    285
    #19
    thanks a lot for help, guys.

    what does 10Mb port mean? which one is better? 100Mb port or 10mb porT?
     
    toby, Sep 21, 2007 IP
  20. hostmellow

    hostmellow Peon

    Messages:
    31
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #20
    This port means your highest capability of the PIPE going to be 10Mbps if you are using 10Mbps port and 100Mbps if its 100Mbps port, basically its 10 Megabit Per Second and the other one is 100 Megabit per second :cool:
     
    hostmellow, Sep 21, 2007 IP