I have found that most people don't notice, or don't care that your carrying. I sometimes will get odd looks but I like to think I got those kinds of looks before I started to carry
My best advise to you, is that you look up the laws on audio and/or video recording in public. Then get a recorder and carry it all the time. It may come in handy if you are stopped by an officer that would otherwise try to charge you with a bogus crime.