Understandable. But even when off duty you still represent the United States Government, especially if you're wearing your uniform. People are still going to connect that since you're in the military you're entitled to carry. On the other hand, I'd definitely make sure this is cool with your command. For some reason I don't think armed military members in uniform walking around buying grocery sounds all too kosher.