Is it only me or are Roller Rockers noisey ?

The aluminum rockers from comp are supposed to be good. If you bolt on the stamped steel you can't adjust. If you have the correct pushrods you can try it but I don't think it's your rockers that are the problem. I would check and play with preload first.