Geothermal -- Heat home, cool home, heat domestic water, save 70-80% energy usage of home heating/AC/hot water compare to electric/oil. High initial cost @ 50K (CAD) for an average home.
Heat pump (air-to-air) -- Heat home, cool home, fresh air ventilation. Relatively low initial cost @ 20K (CAD) or less save 50-60% energy usage of home heating compare to electric/oil.
Gas is slightly better than electric heating for energy consumption.
Electric baseboard is second to last at energy consumption.
Worst energy consumption is oil furnace.
Electric HWT is the lowest initial cost solution for domestic water. Gas HWT install cost about 30% more than electric however it consume slightly less energy to operate & heat recovery time is 1/3 of electric.
Instant on-demand hot water heater cost 2-3X more than electric HWT to install, however it is claim to use much less energy pending frequency of usage.
The best solution is to go with 2 systems that your pocket book can afford, because all solutions isn't impervious to down time (power failure/gas interruption).
Geothermal & Air-to-Air heat pump generally use electric coil backup, or electric/gas boiler.
IMHO, one should have a system that uses gas & wood as back up heat source.
PS. Heat loss in the home is generally due to poor insulation & windows, therefore increase your R value, double panel windows is a must (better yet, no window...live in a cave), and install a ventilation system to lower the humidity level (prevent mold).
It is also is nice to have your own water well, water filtration system, UV/filter for air/pollen cleaner.