Clutch fork / adjustment rod / torque shaft....

I attached the adjustment rod to the clutch fork and it's at an angle that doesn't look normal to me.
No, that's not going to work once the headers are on, if you can even get them on..
>Take a very close look at Post #6, which looks just about perfect.. which is what you want.
In your install,
The ends of the Z-bar are gonna be moving in too many directions at once. The Z-bar should be at 90* to the centerline of the car in Plan View, and parallel to the ground in Rear view, and the BH-ball should be nearly buried in the tube. That would position the Z-bar arms in a way that they can ONLY move fore and aft. This will center the pedal downrod in the Firewall oval, and set up the adjustable TO rod up next to the BH, so that, stuffed into the TO arm, it operates straight back and forth, out of the way of the headers.
Notice in Post *6. how the TO arm comes way out of the BH window, to meet the adjuster. There is a long and a short TO fork; IIRC yours should be the long one at about 11inches ....... IIRC. EDIT; poster #18 below says 12.5.
After you get the angles worked out and the headers are in, be prepared to fine tune it. In Oldmanmopars pic, notice that the inboard Z-bar arm, has been tweaked between the header and the starter; I had to do the same to mine. But in my case, it wanted to kick the clip off, so I had to double-bend it, to get that lil pin back on a geometrically correct path.
>The frame end can be shimmed over, but keep the downrod mostly centered so it doesn't cut the boot. After that ball is properly positioned in the apron, it needs to be secured there, usually by welding, cuz anything else will tear the apron sooner or later.
>IIRC somebody offers an already modified Z-bar for your application.

Good luck

Other tips
To me, it looks like your engine is NOT in the right place. She appears to be too far to the P-side and too far forward, and too low. But if that was true, then you would have had a lot of trouble installing the rear crossmember.
If you didn't have that trouble, then I gotta suspect the frame-end is in the wrong place, which makes more sense.
I suppose, I would check the K-member placement and/or the frame geometry. The FSM should detail that.
I feel your pain; Slow and steady..............