Fender Trim Holes

I'm working on a '70 Dart and I would like to leave the side trim off. Well, there are a bunch of holes in the body where the trim is held on with clips. How would I go about filling in these holes? Should I use body filler? Thanks!