I run 3.55's in my Duster at the moment, and have put about 40k miles on the 3.23's in my Challenger. I ran 2.76's in the Challenger for probably 20k miles or so, and 2.94's for a bit in the Duster but it's got too much cam for those.
The Challenger lost about 2 mpg going from the 2.76's to the 3.23's with no other changes. It's a stock/mild 318, cam is stock or close to it, has a 600cfm 4 barrel and headers, nothing fancy. It was built by a previous owner so I don't know a ton about the internals, safe to assume it's just a fairly low compression 318. I was getting 17-18 mpg on the highway with the 2.76's, about the best I do now is 15-16. I would guess you'd probably lose another couple mpg's or so going to 3.55's. I can't use the Duster as a comparison though as I've never run 3.23's in it and it makes a good 150 hp more than the Challenger, so I try
not to keep track of my mpg's in the Duster.
I wouldn't go higher than 3.55 for the freeways out here. You have to be able to pull a consistent 70 mph on the freeways in California otherwise you get run over, even that's marginal for SoCal. With my 26" rear tires and 3.55's I turn about 3,300 rpm at 70. It's manageable on longer trips, but it would be nice to keep it at 3k or a little less. At 80 it's closing in on 3,700 rpm, and that definitely starts to get old after awhile. With your
23.4" tall tires and a 3.55 rear gear you'd be turning just under 3,600 at 70, and almost 4,100 at 80. You will not like that for 300 miles, not at all. And holy cow are those short tires!!!
If you're on the freeways in SoCal with any regularity, you don't want anything more than 3.55's, and 3.23's would be easier at the pump. You will miss rolling down the freeway at close to 80 mph turning 3k rpm with the 2.76's on those 300 mile trips out to Havasu.
This is a neat little calculator tool that lets you play with your gearing, tire heights etc and will tell you what kind of rpm's you'd be turning with each set up.
http://vexer.com/automotive-tools/speed-rpm-calculator