I've always hit the outer lip inward at four places with a washer inside, then pressed them out from the other side with a vise, whatever socket fits for a receptacle, and another socket to push with. This process relieves a lot of the interference fit, and surface area touching the arm. Since the lip is gone, you may try picking at the edges until there's enough to hit. A flat pin punch would probably work better than a chisel for this. Relieving the pressure really helps. To the left of the vise, you can see the old sleeve with the edges pushed towards the center.
View attachment 1715017402