a test light won't pass enough current to make a buzzer sound off. You need to hook the buzzer up directly to the battery. Just be careful since your not sure if it's actually a buzzer. I'd use a fused test wire to hook it up. That way if it's not a buzzer it won't fry anything, or you.
