Exhaust manifold leaks

I got the rattling to stop by rotating the riser all the way. I tried to see which direction is open and closed. But exhaust still came out the tailpipe either way it was rotated.

I think the main leak is coming from where the manifold connects to the head. It is pretty loud, but I cant find exactly where it is.