What's the best way to find a dead cylinder?

Bodyperson said
Water spray bottle on manifold

I'm assuming that you mean to spray a Windex bottle stream on the exhaust manifold adjacent to the engine and see if it boils off. Could this harm the exhaust manifold or crack it?