I don't think it will affect SEO. if it went back, it will return. My domain got expired and went to domain parking about a week. I don't see any drop in ranking today. This happen a month ago
One off server issues will not cause a major problem ... however if the same happens on a more regular basis, then that is an issue you will want to deal with for better SERP's.