power steering belt adjustment

My power steering belt was making noise, so I loosened the bolt on the water pump and puled back, but it only made the belt looser. I know this is basic but it must be over my head. Can anyone help? 1971 340