I concur.
Pick your favorite disto and go for it!

MAke sure to use a 64 bit one if your system supports it.. Some sciences run a lot faster in Linux X64(like the GFAM, DSFL and SN2S projects)

Take the "Linux distro you like" is smack on to me [There are though lean and leaner stripped distros, requiring more hands on], but, there's the overhead you'd like to minimize when not using the machine for longer. Executing a command to unload the GUI is advised. Typically for later Ubuntu that's in console having Unity/Dash:

sudo service lightdm stop

or before for gnome GUI

sudo service gdm stop

The bit to change in the command is the gdm/lightdm part depending on the distro and GUI engine chosen.

Also, as I've written many times when using WIFI under Linux, disabling power management improves network performance dramatically and stops BOINC crashing tasks when it cant fine a live wire [WIFI gone to sleep and slow to revive]. Command for Ubuntu in console [terminal Ctrl-Alt-F2 e.g.]:

sudo iwconfig wlan0 power off

(automate this command at startup)

At any rate, my Linux box has not seen GUI for probably 3+ months now... it just crunches at 99.6-99.8% efficient... least possible overhead.