284 484 cam and power brakes

I have a Comp XE268 in my 318 in my Duster with power brakes. The cam is
.477/.480 at .050, so it is quite lumpy. The brakes still work decent, but are somewhat spongy due to the subtracted vaccum.

I am interested in switching to manual brakes. Can I take a few pieces off another abody to complete the swap? What needs to be done and will it feel better than it does now??