don't worry you won't get windows at that price. And for 3$ a vps won't be powerful even when having 1gb ram as 1 server will be hosting more vps which causes overload in server. I bet you might want to choose a shared hosting with your budget. Atleast 20$ is a decent budget for vps, the cheaper you go, the more downtime, the more load you face. And no support you get. But you can get the vps from demon vps. I bet it won't give you enough performance. I used the servers once for VNC connection. So if you have lower budgets don't try cheap hosting. Its bad. you can contact me if you need any technical help with your vps.
Could you let us know what is the VPS going to be used for ? Are you looking for a control panel with it ?