Headlight switch removal 63 Dart

OK
I'm removing the push button shift bezel on my 63 dart and I'm trying to figure out how to get the headlight switch knob off whithout breaking it. The windshied wiper knob has a screw that holds it on but the headlight switch doesn't seem to have anything. I assumed that it was just a friction thing and that it should just pull off but it seems to be on there very tight.

So before I get a big pair of pliers on it and break something, is there something that I'm missing?