thrust button removal?

hello. installing green bearings on the factory 8 3/4 axles. I have a 742 case 355 clutch type sure grip...I heard/read I have to take out the little thrust button in the center section. Is it a must that I remove it to use green bearings? I tried to take it out with a magnet, and needle nose, but it only slides out a little then stops...i dont want to damage it...any ideas?