Oil Pump Fitment

FWIW, the pump housing is not designed to fully seat against the small step in the shaft hole that you show; the housing just needs to engage that hole enough to allow the hole to locate the pump laterally around the shaft axis. It could be a burr as said or the pump is not machined right. Does it go in part way and then stop?