Sorry about replying to my own thread, but I wanted to keep MY answer separate from the question.
It seems to me necessary features are:
1. Concealability - So the evidence does not get confiscated
2. Long Battery Life
3. Ability to hook up to a computer to save the resulting audio file.