Can we talk about "center bore" for a minute?
If you are using your lug nuts to center your rims and experience a vibration that sometimes goes away when you remove and reinstall your wheel, you may want to buy hub-centric rings to center your wheel. They come in plastic or aluminum and they just cost under $5 for (4). I use them where needed regardless, best of both worlds!
Other than that, if it is working for you, leave it alone.
Problems come from wheels being over torqued, one lug being driven home before the others, the conical seat in your soft aluminum rims being torn up, conical lug nuts being gouged and wrecking the seat in the rim further...