Can you really pull a battery cable and the engine still runs?

If your battery is dead and you jump your battery to start the car then disconnect the second battery isn’t the car basically running on the alternator until charged? Which is common?