Ok. Yeah, usually they'll set up nearby to gather the information from your card. Has to be line if sight. Places where they can loiter like McDonald's or parking lots are popular.
Sucks
So sounds like a skimmer as others have said. Double check any point of sale location like that for something out of the ordinary or if it seems loose where it shouldn't be.
Avoid odd ATM machines as well
Plus side of using a credit card is that you can dispute the charge.
I shudder at those that use debit cards. You generally have no recourse.