Stop in for a cup of coffee

Makes sense.
I think if people were in the background, they wouldn't distract. But you're the artist and you have to do what you think is right. I can also see how adding even background people could be very difficult to pull off without being distracting. It would be similar to the problem of framing a subject in a non-staged photo - but harder.