Your thinking is correct regarding HVAC, but is off the mark with exhaust. We are dealing with heat, sound and motion and the motion is very high speed gases. There is no reason to run pipe larger than the collector as roccodart points out, but neither should the exhaust be smaller than the collector either. If it is smaller. It should be as little as practicable as possible.