Locking out advance with welds

That would do it, but you want to weld it with the weights where they are in the picture so the rotor doesn't end up partially out of phase with the cap terminals.
A light tack where the green is might be better, unless you don't care about ever undoing it, but those distributors are available everywhere.
It would be a lot easier to undo and have the distributor work right again later if the weights themselves are not welded to the slot.
Leaving or removing the springs won't matter one way or the other, but if for some reason you want to remove as much weight as possible take the top section out, knock the slotted plate off, take the springs and weights out and weld the shaft like RRR said.

distributor_weights.jpg