Cam swap without pulling motor

Reinstalling valves and installed height of springs is a little on the high side by 0.030" or so. I have some 0.031" shims, so the spring height is easy to fix. The previous valve job left the valves about 0.040" uneven. I got them within 0.010"-0.012" with the new valve job. I would imagine that the valves are now around 0.050"-0.060" deeper than original. At what point does this start becoming a problem with stock rocker arm geometry? At a minimum I may need shorter pushrods. Should I consider grinding a little off the tops of the valve stems?