Do I have reason to be concerned???

You could check it with two V-blocks and an indicator, at least within .003??:

View attachment 1715578157

yup 2 v blocks and an indicator would be the best way to check it. not in a lathe. a lathe would involve too much time spent setting it up with a steady rest and would basically be accomplishing the same thing as the v-blocks