Wrong 4-speed?
Mine was whisker close but did not touch with the car going straight down the road but under cornering it would and would send a vibration up through the car. I nipped the corner off the offending boss.
You could likely dent the cross member or may not have to do anything, it will depend on the particular vehicle.