It's really no problem at all if you either have access to a press or make a bushing tool based on the ones shown here:
http://www.forabodiesonly.com/mopar/showthread.php?t=58818&highlight=home+made+tools&page=2
Definitely do it while you have the front end apart.