1965 Valiant brake woes

I'm pretty sure that whatever is going on with the booster is causing some idle issues, too. It's surging at stop lights with my foot on the brake. It acts like a big block with a lumpy cam!
I just checked the timing, idle adjustment, etc. yesterday. I guess a vacuum leak from the booster could cause this?
yes. 100% it could, and will.