If your wife/gf/significant other says "don't carry in our home" then you don't unless you're willing to lose that wife/gf/so.
If your employer says don't carry openly / don't talk politics / don't speak any language other than English / don't eat sunflower seeds while on the clock, you Don't. Unless you are willing to lose that employer.
They can tell you what to wear, what not to wear and how to wear it when it comes to something as basic as clothing. Why would you think that didn't include other 'accouterments' such as a visible pistol?
Be thankful that you can carry concealed, at least it's carrying.