That's true, and a good reason to get rid of the end link/bushing set up that was on the car previously.
But realistically you're only talking about ~2.5" of travel in each direction, so it's not like you need to have something anywhere near as tall as the factory end links to cover the divergence in the arcs. It’s not that much in that relatively short distance.
This is the set up that I’ve been running for years and tens of thousands of miles, it doesn’t bind up the LCA and those are poly bushings. Obviously you don’t want to interfere with the motion of the LCA, but the more “give” that you have in the bushings and end links the less active your sway bar will be. There are tons of heim jointed sway bar end links out there.