Too much gear?

Your lower gears are hiding the need for a higher stall. but that still don't answer why you lost 4 mph!
The bigger cam wants more stall. It may want more rpm as well.