Lack Luster Brakes

I don't have a '70 FSM, but my '68 manual states the pushrod should be adjusted to .910-.920 above the mounting surface with the filter housing attached.
The '68 manual also shows a different booster being used in drum applications vs disc (Midland-Ross vs Bendix). Don't think it should make a difference, but the factory did change them for a reason.

Interesting... There is nothing like that in the 70 Service manual. I guess if I ever take off the master cylinder Ill take that measurement

Here's something to consider;
New brakeshoes never match used drums. That is to say, if you lay a new shoe into an old drum, and manage to not hang it up on the ridge, it will rock up and down the friction surface. This means that the shoe is only contacting the friction surface over a tiny patch. It will take thousands of miles to break-in.
If it's a bad enough mismatch, you'll get extra pedal travel, as the shoes force the normally round drums, into an oval shape, at which time the pedal will get harder and braking will improve, but it may take both feet on the pedal to achieve.
If you machine the drums to restore them to round, this changes nothing, because the shoes are still only contacting in a tiny patch.
The proper procedure to cure this situation, is to take your shoes and drums to an old-school brake shop, and have the new shoes ground to match the radius of the old reground drums. If the drums are excessively worn, then the shoes will have to be excessively ground, reducing their lifespan.
Oh God... I didnt even think of that... I guess that would be very easy to determine if I am taking the drums off anyway. Thanks for the idea.