Pushing brakes raises idle??
I bet it's normal. Just push them once, do understand you "pumped" them as in multiple times?
You have to remember that everytime you actuate the brake pedal, the engine has to evacuate the booster again, so there's a little "puff" of air goes into the intake manifold.
Might be your idle screws are a tad on the lean side.