i wouldn't try it with a grinder. but knock down the big ugly with a file and then use paper on a rigid block, slowly and methodically working your way up thru grits should give a satisfactory finished product.
i may get dragged for this, but a composite gasket might be a call for use here. a good MLS gasket would probably be fine TBH