I know it's too late, but all he had to do was add 4% to the charge to cover the fee for "goods and services," then both the buyer and seller are happy. Sorry you're going through this.
It’s not too late for him to reimburse, and try to recover from this.
It’s called the cost of doing business. Either you do right by your customers, or someone else will take care of them .