when you say keep TO bearing off fingers you mean when it is in neutral there should be no contact with the clutch fingers. Can see this if I remove inspection cover?
When the clutch pedal is all the way up there should be a gap between the TO bearing and the clutch fingers. Being in gear or neutral has nothing to do with it.