.
No button to remove. You can grind the end of your axles to get the little bit of play you need.
In your carrier that centerpin is designed to wiggle back and forth. That's because with tapered axle bearings the axles are shifting a little bit from side-to-side going around corners and such.
But since you have green axle bearin your wiggle is very limited.