I don't like this gas pump credit card thing at all.

I haven’t run into a card reader that I can’t remove the card myself - I wouldn’t trust them either.

Many ATMs and credit card readers are serviced by an outside company.
A thief can go and swap out a card reader for a fake one in about three minutes.