These guys are likely on the right track with polarity but you cannot just "turn it around" This is an 1891, single contact, bayonet base.
So, I do not know how the socket is wired. It is above ground, as the switch grounds the circuit, but it may be factory wired with power to...