As a former resident of Colorado let me welcome you to OCDO! :celebrate
The SERPA can be a real pain to remove, but it was designed that way. I broke a paddle once after flexing it a thousand times for removal. Blackhawk promptly sent me a new one. Now I just remove my belt first before taking it off.
Besides, you should only have to remove it to change your pants! :P