Carter fuel pump bad out of box?

I've had two of them now. Supposedly you can rotate the housing to a different position on the ones I've used. While the engine is running, both leaked at the diaphram even though the screws were tight. Will never use another one.
The one I have is their least expensive and is not adjustable like you said. It's a sealed unit. Like @inertia recommended, I removed the gas cap (I have a locking aftermarket) and started over. It still did exactly the same thing as described. The oil appears uncontaminated, thanks for that reminder @GTX JOHN.