70 Swinger lower door hinge ???

I just got pins and bushings for the Swinger. I got the top done no problem, but the bottom one is a different story. It looks like the lower never had a bushing, and the ones i have will not fit. So i need to drill the hole out to accept the bushing, OK the outer part of the hinge fits very snug to the inner and if i put the bushings in i dont think the two parts will go back together. Maby if i grind off some to gain clearance. All of this i can do but i would like some feedback frome someone thats done it. Thanks