The thing is lots of smaller exchanges did not use all seven, so the letter prefix was not used. Our area was "officially" CO for COngress but you only used the last 5 locally
I grew up in a very small town too. If calling within the same prefix, dialing the last 5 digits worked. If dialing in from another prefix, you had to use the full number.