5.9 Magnum flywheel - DIY with bolt-on weight??

Not sure why a neural balance flywheel would have holes drilled. Do you have a pic?

Sounds like you know very well you might do damage using that method. I imagine you also know there's a lot of things that can make an engine feel like its out of balance (examples: bad plug, bad wire, timing off etc).