Any drawback to keeping the drum spindles on my 66 Valiant?

You couldn't give me 9" spindles.
You couldn't pay me enough to install them on my car.
You'll know why, when you see your wheel rolling down the road in front of you, hunting for a target. There are bigger bearings on lawn gliders, than are on the outboard end of one of those spindles.