Any drawback to keeping the drum spindles on my 66 Valiant?

I put lots of miles on 9” spindles and a scarebird kit. It worked great and I never had a problem, but I always worried about those tiny bearings. The 10” inch brake spindles and hubs are much heavier built with better bearings.