By-pass hose?

Can I ask why you would take the by pass hose off? Does it increase horsepower? Improve fuel economy? Save weight? Save $3.95 at O'Reilly's?