What would you do with the information that police have been called about you? What should you do?
I am planning to bring a camera with me to record just in case, for my own protection. That will give me the warning to turn it on, if I cannot leave it running the entire time. However, if no crime has been committed (and certainly none will be by me), my understanding is that I have no obligation to stay. If a "situation" unfolds like I'm describing, I will likely be walking anyway, so staying would be a deliberate choice.
I've watched some videos recently of OCers and drivers asserting their rights with police, which have bolstered my pride in the OC community, and my confidence in being able to do the same. Part of me would want to stay to flex my rights. The other part of me would want to avoid conflict if at all possible. A balance might be something like watching from a distance to check out the temperature of the situation.