Sounds like the bulkhead connector as mentioned, or somebody forgot to tighten something to me.
Those would be my first two thoughts on it.
Is your stereo wired through the ignition, or direct?
Meaning does the stereo go off when you turn off the car?