Be more knowledgeable about the various solutions out there.
Automate all facets of server acquisition and maintenance: Chef, Puppet, Capistrano, PHD, moonshine, etc. I want this thing to build itself, rather than to have me having to spend weeks configuring it and setting it up.
I know of:
EC2 (which probably won't work because of the persistence issues)
I don't need DNS hosting (already use DNS Made Easy), Email (using Google Apps), or any sort of webmin like interface.
I just need SSH, root access, Apache, MySQL, Ruby, Passenger, PHP (for old stuff), running on Ubuntu and that's about it - anybody got any recommendations?