There are furnace units that are designed to fit in the wall between studs.
We got one from a local guy, and it slid right inbetween the studs.
I will have the gas run shortly, and a thermostat added. The furnace was a trade, and the plumbing and thermostat will cost me 250.
We burned more then that last year in propane bottles.