I personally use DigitalOcean and find it to be quite user friendly.
They use what they call "Droplets" to create a VPS. You can have multiple at once and it only charges you for the time you use it, and you can delete add more at any time. They'll just bill you at the end of the month for the usage.
What's nice is that it also has a marketplace, so if you want to spin up a Docker Ubuntu server, or a vanilla Debian server, you can do that with one click.
Yeah, I guess when it comes down to it, if you want 100% control you have to pay for it yourself.