Yes, I have changed hosting for two of my domains twice in past and it did not really hurt my SEO ranking. Make sure all your site URLs work without any 404 error after changing the host.