Starting and Running Problem...

Can I just take it out and look at it or how does that work? Right now it is filled with oil... I'm so scared that it is just going to come off again and seriously damage something.

No you don't have to take it off.... I was just trying to figure out why it keeps backing off. Does it turn more freely than the others?

Pull the push rod out and see if it is bent... don't worry it will go back in its proper place without no problems.

If it is not the rocker, rocker adjusting bolt, or push rod then it might possibly be a wiped out cam lobe.