Trust me I definitely understand the general sentiment. But if you're looking at what you would actually feel by the butt dyno, The larger displacement area under the curve difference is huge.
In fact I would go so far as to say that even properly geared stalled etc the bigger engine is going to win by virtue of that increased area under the curve. It's making more power across a broader RPM range you can work with that.