I thought about the same thing.
I see a couple of problems. I think it would not be legal unless they were saying that they were going to hurt you with the bat.
I would try to exit the confrontation. Say I'm wrong, apologize, and walk away – doesn’t matter if it is true.
Once the attackers have deployed violence then it would be self-defense. The problem is you have to wait until someone gets hit/hurt, and then you can only defend against that person.
OTH - if I had myfamilythere and someone was making a creditable threat... What did someone say? I would rather face 12 than be carried by 6. When my family is concerned, I would much rather face 12 than be one of the 6.