Electronics Issue ATX PSU Cap Eruption

A higher voltage rating on an electrolytic cap is always "good." But I would try to find out what the circuit actually runs for voltage. It might be that the thing is still marginal

In this day and age there is NO EXCUSE for not having good quality caps. Even back when I was young they didn't fail often, and often when did, was because of long storage non-use.