You have a performance cam, it's probably not creating enough vacuum to operate the booster correctly.
You really need a minimum of 14 inches of vacuum for them to work properly.
I would suggest getting, if you don't have, a vacuum gauge.
Tune the carb to get the highest reading.
Your other alternative is to add Hydro-boost OR go back to manual brakes.