340 vs. 440? (Help)

This topic involves a big / small block decision for my 1971 Duster that I hope you guys can help me with. This car is meant to be a very nice custom driver that can occassionaly lay the rubber down on the road. I know the old sane "there is no replacement for displacement" but I am worried about driveability and handling associated with weight. Anyone who has ever driven both a small block and big block car please chime in with your experience.

What is the approx. weight of the 340 vs. the 440 motor dressed?

Option 1: 340 stroked out to a 416, topped off with a sixpack and followed up with a 4 speed 833 23 spline.

Option 2: 440 stroked out to a 500, topped off with a sixpack and followed up with a 4 speed 833 18 spline.

Oh yea you're going to get a lot of opinions on this question. First off these engine weights are with their factory supplied manifolds.
340-525#, 383-400=620 and 440=670
Keep in mind you can shed a lot of weight off the BB's by going to aluminum intake, aluminum water pump, headers and since you're looking at strokers aluminum heads.
Personally I've driven both A body SB's and own a A body BB and for the life of me I don't feel much of a difference, now I've lightened mine up further with a fiberglass hood so maybe I'm not making a fair comparison. But hey I just don't see any difference in the handling, maybe if I was racing it on a track I would and that's JMO.

Terry