Differing size pipes make much difference?

I'd go 2 1/2 from the collector to the tail pipe tip, I never mix and match.