Because your geometry will never be correct if you don't do something about it. Ever.
It's actually B3 racing engines that makes a kit to do the correction. IIRC, with the same rocker, .620 gross lift and stem height about .050 higher I needed a .240 up and .060 back correction.
That's a bunch. But my sweep is about .045ish IIRC.
Forget about getting the sweep centered. Get the sweep as narrow as you can.
b3racingengines.com
EDIT: my post only applies if you are using econo W2 heads. If you have the stands milled and have offset shafts and blocks than ignore what I posted.