Replacing a lazy lifter

Well... You should.

No, conventional wisdom is not to soak them, just coat the sides with oil and the bottom with break in lube. When you soak them they will hold the valve off the seat at initial start up and risk burning the valve, its safer to let them clatter a second and pump up.