loose shifter for 3 on tree

Ok, so I finally was able to get somebody to give me another pair of eyes and check out the loose shifter on my 65 valiant /6 3 on a tree. So, here's the findings. when I move the shifter up and down the connectors and the shifting linkages all move correctly. they are tight and move with the movement of the shifting rod. the problem is that the shifter is very loose and will fall out of 2nd gear from the top when driving down the road sometimes. I have tried to remove the steering wheel and the horn button but I cant seem to get the middle column sleeve removed and remove the shifter.

yes I have a manual, and no that hasn't helped me. I did see in the column that there is a bearing in there but from what I'm reading I have to take out the entire column. I hope not, I don't have enough faith in myself to get it back together to function as it should


any ideas?