We've toyed with the idea but haven't taken the leap yet. The issue is bandwidth and disk quotas and how to enforce.
You're better off getting a windows vps instead of a RDP cause companies who sell RDP overload their server so you get crappy CPU
If this is just for web browsing then why a Windows VPS? Why not get an RDP login to an ubuntu VPS which has a lot more stuff than a web browser?