I messed up....

I was thinking of drilling a hole in some 1/8 plate, then cutting it in half. Thin it out along the inside edge and use that as a wedge clamping it to the press
Just like the fixture to remove rear axle bearings.

ALTERNATLY...

you could make a fixture to press the bushing in by gripping the flange just under the poly, kind of like a PS pump pulley remover but used in reverse