If it was easy everyone would do it......

I always have better luck with reverse cut drill bits, A.K.A left hand drill bits.

The broken parts usually come out on the end of the drill bit.

PS: you may want to sand the manifold face flat to ensure no warpage.