As far as what someone can do if they see your gun, it depends on what state you're in. In Texas it's against the law for it to show; the cops may be called. In Idaho, if my concealed weapon shows, its no problem.
I also choose to carry concealed most of the time, though I have made a commitment to OC once a week. Finding the right holster for you will depend on several things. You may have to alter the way you dress a bit. Personally, I carry "mexican" style, IWB just to the right of my belt buckle. I use a galco leather holster made to fit my Ruger SP 101. For me, I had to start learning to wear my shirts untucked...I'm much more used to tucking in my shirt. Having a good belt is important too to spread the weight out and secure the gun properly. Having the gun up front I can always see if it is showing and it is always in my control. I carry a speed loader in my right pocket and never carry anything else in there. After a lot of trial an error, this is what works for me. Take a look at some of the milt sparks holsters...you may like some of their concealed options though none were right for me, it's quality stuff.