I personally wouldn’t want to gamble on potential fines and having to tear down a structure losing all my costs and efforts for the sake of jumping through the hoops of getting a permit.
Besides, if it’s legal, you can tell your neighbor lady to pound sand if she doesn’t like it.
IF anyone calls, I just have to draw "as built" plans.....The neighbor who is affected, some, is the one who moved the survey stake and stole 10 ft by 100 ft of my land. AND she knows I know it. So she is not likely to make any waves.....