Yes , they do have time to bleed down at higher rpm, even the slightest bleed will be effecting your cam timing. Also if you go to a lighter weight oil, or heaver valve spring, it will also effect how the lifter performs. Why do you think the cam is "lumpier" and the engine has less Vac when it's cold?