I use ubuntu (postfix & dovecot) as our mail server at work running in a virtual machine under ubuntu, never skips a beat.

The host machine is a quad core with oodles of ram as it also runs a number of other virtual machines (svn, database and others which I always forget).