How close is to close?

Is that a Mach water pump pulley? If it is a Mach pulley, it is thicker at the mounting base. Try using a stock pulley. The stock pulley is much thinner at the mounting base. You will gain some clearance.