How do I remove this piece?

You are probably right about the burr. I will give it a try this evening. Need to replace the turn signal cam also. Thanks