Should I grind the steel rockers?

Did more grinding till the cardboard feeler guage fits.

I got 8 more to go and I'm doing this very slow, but just want to be careful.

Also, the dimple on one of the rockers is from when I used a ball shaped burr, it is fine.