http://www.lunarpages.com
They offer a lot of different stuff along with their space, including the things you're looking for. I'm not an expert by any stretch of the imagination, but they can make you look like one.
I think a lot of people like dreamhost, so check them out as well.