When I had high/tight spots on a bushing I would rub the shiny spots with a smooth steel shaft like a chrome screwdriver shaft to flatten them down.
Sanding soft metals like bushings can leave rocks imbedded in the material.
You might be able to put the drum on the hub and tap with your mallet all around the edges of the drum to get it to smooth the bushing down.
Is it just the picture or is that bushing kind of trashed on the edges?