cant get bolts in intake

The bolt holes on my intake dont line up ! The heads have been milled and the intake seems to fit ok but I wont beable to get the bolts in one side. Is it ok to grind the bolt holes lower ? Is there a better (or proper) way to fix the problem. I dont think the intake needs to be milled to fit, it sits fine on the heads.