From the sounds of this, I would probably sit down and determine which things I normally do that are essentual. If that filled up maybe 40 minutes a day I would spend the last 20 minutes doing whatever hair brained idea I had at the moment.
Outsourcing definitely, especially if with the new job it gives you a little extra to play around with. You could probably find someone who could go around link building manually by posting comments/forum-ing (genuine comments, so you don't get spammed) very cheaply - maybe 250 links/comments/posts for about $10. (I don't really know if that is "cheap" but I know I would pay somebody to do it and maybe even consider doing that for $10, lol) An hour isn't a lot of time at all. I could take that much time just filtering and responding to emails...the 5 hours on the weekend is where you'll be the most productive. Good luck with the new job!