I carry my XD(m) at 1 o'clock, i.e., AIWB (appendix-IWB). I didn't like it when I was using a soft holster, but since I got my Kydex ArchAngel holster from Dale Fricke, that's the way I carry, and it's been very comfortable, plus, much easier to holster and unholster getting in and out of my vehicle. Plus, I don't have to worry about being made when I bend down at the store to look at something on the bottom shelf.
I used to carry at about 4 o'clock in a soft, Uncle Mike's IWB holster, and I still carry that way when I have to wear a dress shirt and suit coat. That was also very comfortable, but not as convenient.
Drawing the weapon is a lot faster with the AIWB than the 4 o'clock carry.