So if/when you wash the car, it sits in the rain... absolutely no way water could get between there? even around the bolts? If so you created a pretty good dam
In my opinion, Only advantage to some filler between the panels here is to prevent a possible whistle/wind noise. I don't know enough about the airflow to say that is possible. Good luck to all either way.