I'm not sure if there is a quantitative value you should be looking for (1/8 inch this way, or that way).... I just know that when I was chasing down a similar vibration years ago I was able to remedy it by replacing the bushing with something like this (polyurethane I believe). The one I removed was pretty worn out and cracked.
Yea i can move it side to side and can push it up as well by hand prob closer to 1/4 inch,anyhow will be removing it tonight,hopefully and get a better look.I also have maybe a 1/16" of up down on the slip yoke in the trans,normal?