Rocker arm problem or something else?

More importantly look at the condition of the cam lobes of the "used" cam, (if the used lifters were a consideration of being reused) if the used cam lobes were in "pristine condition" the corresponding lifters should be OK. If the used cam lobes are chipping, flaking or wearing, don't use those lifters.