Head Porting question

Would it be worth it to port or at least gasket match a set of 318 LA heads (675 castings, small valves, no smog ports)?
The bottom end of the motor is a bone stock fresh rebuild. Comp cams XE256 cam, lifters and springs. Performer intake. Holley 600 carb. Hooker competition headers. 3" dual exhaust with flowmasters. I am going to have the heads milled .060 and going with a .028 head gasket to bump up the compression ratio a little.
Magnum heads or 302 castings are out of the question. These heads are fresh and don't want to waste them.
Would it be a waste of time? I plan on at least cleaning up the runners a little. Thanks