Trans is in.

I have a errand to run this morning. Then it's going up on my jack stands to check it. I did forget to ask a question. Is it safe to run without the inspection plate (the big one) if that is the problem?

Yes it is safe to run it without it, but only for as long as necessary.
Anything can get in there any time and get in the way of the seal lip causing a leak and/or damge to the seal.
You may never have a problem with it, or it may get a leaf or something in the seal and cause it to leak,

Mine is not on yet, but I have one,:D
Just waiting for good oportunity to put it on.

If this is where your noise is, you will want to THEN look for the spot it's hitting, tweak it a little and try it again until there is no contact between them.
Sometimes it takes a few tries to get it to clear.