As cheap as mini splits are, they are hard to beat. I've put a bunch of the Chinese units in and don't have much trouble from them. You should be able to find a 12kbtu unit with heat pump for around $700.
After having one, I'll never go back for the noise alone. They are so much quieter...