Darn shifter knob

OK i've read the last post on removing the shifter knob and so far I can't figure it out.

Is the black button suppose to unscrew independant of the brown knob. If i Push the button in all the way and scew clockwise it all tightens up and the knob stays down, I can uscrew it for a bit until the button pops up and then she's freewheelin.

If I hold the brown knob and try and turn the black button counterclockwise It won't move!!! do I have to put some more muscle into it or is my techinque wrong.

Thanks