Guess this mean I need a heater core

Another way to test your heater core is to turn your heater on full hot. Hot air = good hc Cold air = bad hc

Another test. Hit the high heat in defrost mode.
Window fogging up ? Bad hc.