41 Plymouth Hot Rod Build

Yes it would be best to drain the coolant. You might be lucky and be able to loosen, adjust, and retighten without creating a permanent coolant leak but you are taking your chances.