To Stroker a 360 or Not

Gentlemen, ladies, (or whatever you define yourself as) of FABO. I recently bought a 72 Dodge Dart with a 318. It has a 511 lift Voodoo Cam with 2.62 duration and 9.5 to 1 (I don't really know what that means in terms of actual speed). It has a four barrel Holly carb (750) with electronic choke, and headers. It also has a larger than oem radiator and an A833 four speed tranny. I don't know what the rear axle gears are. I have never owned a "fast " car so I don't know if it is fast. The original owner spun the wheels in second gear when I was test driving. I am considering putting in a strokered 360 to make it go faster. Three trusted mechanics from different shops have told me to leave it alone. They've told me that that swaps never end well and I'll always have to be making adjustments. The last guy told me that there won't be that big a difference in speed anyway. He said, "besides, we have speed limits." I thought that was funny. So I guess my question to anyone who has made the swap is, was it worth it? Did the speed change drastically?