Pushrod length

Yes, performance will be hurt, as, you're bound to lose some lift. Shims are used to negate this. The real way, and expensive, would be to use a rocker train or pushrods, that are adjustable.