You don't need to drop the tank to check /replace the grommet. You can access it from inside the trunk. If it needs installed or replaced, you will need to remove the filler neck.
Now looking back at some pics you're absolutely right.
If I pop the screw off of that black cover I can look right down there... It's always the stuff right in front of your face.