Simple answer is private property owners (or there agents, i.e. store manager, security guard, employee, etc.) can ask you to leave there property. Public property with only a few exemptions written into the law are all carry zones.
Look at it this way. Can anyone just walk into your home? Can you ask them to leave? They're personal property rights trump your 2nd Amendment rights.