Weird 904 to 408 magnum starter interference issue. Dakota starter won't fit? 64 push button trans. is that the problem?

I have a 64 Valiant with 273 and pushbutton 904 running a mini starter. Stock exhaust manifolds