Stop in for a cup of coffee
Laws vary. I understand that. Around here it's called property abandonment if someone puts up a fence or builds over the boundaries and the original owner doesn't file a complaint in a reasonably amount of time. If that holds in your area I would think 40 years is reasonable. Worth looking into.