Odd Noise Around Front of Slant

I started the 71 Scamp today to let it run a while and heard this weird rolling rattle noise up near the pulleys. When you throttle up, it disappears. Moved some parts by hand and found that the pulley on water pump is fairly wobbly. Could this be the source and if so, should I replace the pump?