I've always heard and thought the same but now questioning it.
Idk but I'm thinking overlap is probably the main culprit not necessarily loss of torque cause if an engine doesn't like to idle at low rpms it probably don't like to drive at those rpms too. I'm thinking if there's lesser torque is more of a correlation than causation. But I could be wrong still trying to work it out.