Welding the arm might do it but there is something going on thats not correct. Do you have the correct switch? There are 2 that I know of, a 2 post and a 3 post. I'm pretty sure they can't be interchanged, the contact arm won't work. This might be your problem.
