Yeah, just a little bit. Maybe not the crossdraw but most laymen wouldn't know that that is an unusual carry location for a cop. You're pretty stocky and the shaved head and clean cut look usually means "cop" or "military". Almost all plainclothes cops that aren't wearing a suit that I've seen, dress like you in that photo.
I get my hair cut to a high and tight once a month for my Marine Corps Reserve drills and I dress a lot like that, I bet if I OCed around town people would have the same reaction.
Edit: I think that's why it's important to dress and carry yourself well when representing anything you want to be taken seriously. That's why the military and police depts. have dress codes even when out of uniform. Your experiences are a prime example.