'75 Duster intermittent brake problem

I had a similar issue, turns out the rear brake shoes weren't adjusted tight enough.

Setting the E-brake and then feeling the pedal is the way I check the rear adjustment.
The E-brake holds the rear shoes out to the drum so they don't have to travel when you push the brake.

If there is a big difference with the E-brake on or off, it needs adjusted.