Depends on what springs you have and how close you are to coil bind. Also depends on what your valve to piston clearance is. Changing rocker arms is one good experiment but I wouldn't bother with 1.60 rockers, go straight to 1.70 if they'll fit. And only put them on the intake.
The Trick Flow intake is a better intake than the Victor so you could change intakes for less money than a cam swap. Or get the Victor fully ported. You'll pick up a chunk of power with a better intake and it is a simple swap.
My flat top 470 made more than 700 hp with a 264/268 Comp solid roller. But it had Trick Flow heads and a fully ported intake. Also, the 264/268 roller that I used wasn't very street friendly! I have a customer who runs the same 264/168 cam in his street car and it is a monster. His engine makes over 700 hp with EFI and it required some professional tuning to get the EFI system to work with that camshaft.