a little bit of wear on the blue/blck parts of a gun just adds character. It shows that you carry and practice a lot.
Gun owners who want their guns to look like they are never used are like Harley owners who want their bikes to look they never get ridden... Ya gotta wonder what their real motivation is?...
I fall into the "Triumph motorcycle" camp. If your headers ain't blue, you ain't true...
Safe Queens are for BBQs, not daily carry...
Give the Tucker Silent Thunder a look. It isn't padded, it's a leather holster surrounded by Kydex.
http://rlcompanyusa.stores.yahoo.net/index.html
The Serpa has a little slop/play within it. One suggestion given to me was to sand a little where contact might be made, just enough to insert some felt material. I've not done this myself, so I'm not sure if it works. I was concerned with my 25 year old Springfield Milspec, so I sympathize with you.
On the other side of that coin, you must remember that if you're carrying a piece, you should expect wear and tear. Nearly every holster out there will bear its mark on a firearm. Some with minor wear to the slide or frame, others in scratches.