The symptoms could be due to a 'hot cam' [ which would require more timing at idle ]. But the possibility of a vac leak needs to be checked out first to avoid going down rabbit holes.....
I sprayed water all around the carb and the intake and the idle didn't fluctuate. I will be replacing the valve covers soon to eliminate the extra breather and then Im going to try redoing the timing and carb adjustments.