Disc brake rotor swap

I have converted to disc in front but have 5x4 bottles pattern and want to change to 5x4.5 to allow wider variety of rim selections can I just swap rotors wondering if I’d need to change spindle