I installed those billet aluminum caps offered by Mancini and drilled the yoke out while it was in the car. You are dead on right about needing a drill press to do it correctly. I went through six drill bits and one of the holes is actually at an angle (which I didn't think would be that easy to do when chasing an existing hole).
After installing the caps, I don't actually recommend them. They look better on the site lol. Also, it's damn near impossible to get at the allen head retainer bolts, since they are ~3" long and hit the drive shaft when you try to remove them.
I'll be doing U-bolts on my next build for sure. and drilling out the yoke with a drill press. No more of that BS.