Small port heads, big port intake. How bad?

There is a bit of confusion in this thread.

First, the picture above is one I found on the internet, not something I am doing. It is from the Junkyard Jewel 318 Hot Rod did some time ago. I was looking for the port sizes and tripped over the picture, so I though it might be worth adding to the conversation.

Second, I don't know the history of the car or motor as I didn't build it. I acquired the car as is and I'm just trying to figure out the best course of action. The first being, is the port mis-match hurting me enough to make a change necessary. For all I know, someone matched the ports before bolting it together, but I doubt it. Based on the things I have worked on so far, there wasn't a lot of experience put into the build, for example I get to try and extract a broken VC bolt because they used ones that were too long.

BTW, the car is 71 Dart more door, came with a 318 and 904, Kelsey Hayes disks, 8.75" rear, big front sway bar, Cordoba buckets (drivers side power seat), the afore mentioned M1 dual plane intake, 625 cfm Carter Competition carb, and even a early (69?) 340 unsilenced air cleaner.