AWS RDS requires a certain scale to make sense, it gets expensive fast, but the cost doesn't go up after the first bump.

If you don't need the features (updates, slaves etc) you can get away with just a normal DB in an EC2 instance.