Heat pump water heater and heat pump space heating (indoor home heating) are available. I did evaluate the Rheem heat pump water heater. It’s a quality unit, with low noise emission, worthy of a closer look by you as you remodel or build new.
In the meantime, I do recommend insulation, weather stripping, insulated windows. Think of your building as an envelope, minding where air escapes.