How far should i go with swapping stuff out in the front end?

"Force" is generated in the master cylinder- a power booster is merely an assist on disc and drum systems, not a requirement. Just like power steering- an assist, not a requirement.