Let's say he wasn't your friend, and he just happened to be in the area where you were OCing. Would you have to surrender your rights because of his stupidity? Would he be required to leave?
I don't think one has anything to do with the other as long as you NEVER allow him to possess your firearm there shouldn't be a problem.
In the end, he may have to ask his PO, but my opinion is that it doesn't matter.