I don't like this gas pump credit card thing at all.
I haven’t run into a card reader that I can’t remove the card myself - I wouldn’t trust them either.
Many ATMs and credit card readers are serviced by an outside company.
A thief can go and swap out a card reader for a fake one in about three minutes.