I have personally found that with different handguns it takes a different approach. I can't hit squat with any of my .45 revolvers if I try to aim. But I can shoot a dime out of the air when I just point and pull the bang switch (to steal your term. I love it.)
However I have a lot more luck with my .22 Mark II and my .32 Astra when I actually aim.
I think it really depends on both your gun, and your finger-eye coordination. I mean, if you have to look down your finger when you're pointing at something, then point-shooting probably isn't for you.