Do I have reason to be concerned???

If I was to go to a machine shop, I`d have them chuck it in a lathe and check flange run out. You could test this installed if you have a indicator.