When I was looking for a recorder I looked mainly for ability to offload the sound files to a computer, either via USB or a memory card. I also wanted good sound quality, but AFAIK they all have decent sound quality.
I and several other members have the Sony ICD-PX312. It has both-a USB port and accepts MicroSD AND Sony's proprietary MemoryStick Micro cards. Not to mention the sound quality is fantastic.