Stupid Dust Cap Won't Seat

Mine are doing the same thing. When you go to tap them on , one side or the other ' rocks' in or out. One side will hit the flat rolled edge, but the other side moves away. I haven't checked into it yet. I assumed the spindle end was hitting the inside cap.