Everyone is afraid of too big but no one seems to know what exactly is too big or just right.
And yes boss heads are an example of excessive but many have made good power with them, here's a boss 302 vs a chevy 302 both make very similar down low torque numbers.
Yes, many factors to look at. Compression ratio will compensate. Good swirl or mixture motion from getting bias in the port and quench will also be aids to building torque.
Too big is subjective with the rest of the engine combination. You put those Boss or Cleveland 4V heads on a 408 stroked 351W and that will be a brute. The combination needs to match.
You want to build for 1.4 lb ft of torque per cube, watch DV's videos and get copies of How to Build Horsepower and his BBC Power on a Budget.