Switching from power steering to manual- does anyone do this?

A few month's ago I had all of the parts in my hand to do this swap, and for all of the reasons that you listed. But at the last minute I realized that (as moper said) I do a lot of parking lot driving. So I left it in, and I'm glad that I did.
If you're racing this car and you're looking to scrub off some weight and some parasitic loss by all means go for it!
Ted