Trick to removing quarter window felt?

I need to remove my quarter window trim and in order to do so, the felt needs to come out so I can access the screws. Is there a trick to this? I'm trying to keep from bending anything and breaking (any more) tabs, but it seems counter intuitive. Looks easy to pop in, but kinda a pain to get out.