Vent Window Disassembly - I'm stuck

Is tha pin "sandwiched" with the other piece around it?? Shouldnt the other piece come off?

The sheet metal bracket that wraps around it has a screw that adjusts the drag on the shaft so the wind doesn't move the vent window. That bracket is riveted to the bottom channel. I could drill out the rivets, but then I have to worry about a pop rivet interfering with the gasket.