There are many companies which provide you website hosting services. For example go daddy, host gator, yahoo hosting and many other. Just go to their website and buy hosting space from them and then follow other instructions. These hosting providing companies also include a support team for their customers assistance. You can contact any time and get your problem solved.
You can also use some free hosting website if you are using it for personnel purpose otherwise you can use several other website hosting service like @spyindiaankur said. I mostly prefer GoDaddy !!
As soon as you sign up with any web hosting company, they would help you to setup your blog for free for the first time. Else you have many of the tutorials available over YouTube.
You need to purchase a domain name for your site, then you need to find a web hosting company. I would avoid any EIG child companies since they are unreliable/slow. Check the advertising section, there is plenty. You can also do it in 1 shot, most web hosting providers will be able to register your domain name and push it to your web space. Good luck.
WordPress is great but also realize that there is still a lot of learning to do. You will still need to put a lot of time and effort into learning how to create your web site no matter what you do. There are some great free templates out there for WordPress to get started. Just do a google search for them.
Best answer: "Ask better questions." A question like yours is too vague. It invites everyone to spam you with their hosting offers instead of asking them for specific, useful information. For example, you could ask "Who is your favorite hosting company - and why?" or "What's the simplest platform for a newbie to use for a web site (and why)?" and so on. Always ask people "why" as well as "what". Without a personal experience that generates a reason for their answer, you'll get a bunch of crappy referrals to earn money and very few real opinions.