I knew I had a loud rattle which turned out to be from the clutch linkage bar going to the throw-out arm. It was too loose making a ton of noise so I snugged it up and that noise went away.
I guess you know about setting the freeplay at the pedal? You gotta have at least some, and the TO bearing has to be pulled back off the clutch fingers. There is supposed t be an "anti-rattle spring" down there which does that job. It connects between the TO-fork and the bellhouse where it bolts to the engine; there should be a tiny pocket there to receive it. If not then you can anchor it to anything that doesn't move. After that you can set the clutch freeplay; usually about an inch, but could be whatever you want it to be if you don't mind checking it more frequently. The goal is to set the clutch-departure to some adequate amount that allows a clean shift, especially into reverse; usually about .080 inch...... but could be less.
I don't think this has anything to do with your problem, because you said same noise with pedal down or up. I just wanted to save your TO bearing, lol.