You are not alone!
I got my cqc serpa in June and already it has worn the finish off of my Kimber Ultra Raptor. Especially on the trigger guard where the retention locks on. I just switched out my Raptor for my Stainless Ultra Carry. I am not sure what to do either. Should I send it back to the custom shop, try to find a local gun smith or see if I have the patience with one of these DIY kits! I am fairly disappointed in the way my my Raptor has held up. Not really up to Kimber standards or mine.
The other thing I have noticed with my cqc serpa is that the gun rocks back and forth in the holster. Have you noticed that with yours? I lined the inside of the holster with suede to help with the fit and wear and tear.