will vinyl roof window trim work on non vinyl roof car?

If I were taking the windows out for rust repairs and replacing broken clips, I would clean the old vynil and adhesive off the fence.
I dont quite understand your "drill new holes" though. The vynil goes behind the clip and screw but not bellow the clip. Factory razored the excess material just above the inside corner.

The vinyl goes behind and underneath the clip. So the holes are likely too high (if you are removing the trim). The clips on my car bottom out in the inside corner.