Miles/gallon: Newer vs Older Cars

...but were the older cars just a lot more inefficient? Where have the main improvements come from?

Yes. And I'd say computerized fuel injection caused a great improvement in combustion efficiency. Others would probably include improvements in cylinder head design, intake/exhaust tracts, turbos/supers chargers, etc.