Workstation Build

So, you want to work with big data?

Chances are you're going to need a faster, more powerful computer than the one you're using. Local computing with large data sets versus distributed high performance or high throughput (HPC/HPC) solutions are changing the way we do earth science. Some solutions require HPC/HTC - like repetitive processes which can be distributed to multiple workers across dozens of computer cores. Other processes, like working with very large databases or data which must be visualized, require a local solution like a multi-core PC workstation.

Processing of terrestrial and aerial LiDAR data collections, generating 3D Structure from Motion (SfM) point clouds from thousands of digital oblique and ortho-photographs, and executing large processes in Matlab require a large quantity of RAM. Working with large point clouds (+200 million points) requires both large amount of RAM and a good video card (4Gb+) to display and render point clouds with functional frame rates for editing. Software applications like AgiSoft PhotoScan, and Pix4d suggest at least 128 GB RAM to execute batched processing of a large number of pictures at one time. Statistical and image processing software, like MATLAB put data into RAM - when a process is executed and an output generated those data essentially double the amount of RAM needed. 

Monitor displays, currently running 4k (3048 x 2160) resolution at 60 hz refresh rates also require a large video card for support. New video cards also come with GPU support for further distributed processing capabilities. 

Rather than buying a pre-built workstation which would have increased the price I chose to build my own workstation from parts after doing research online about ideal image processing workstation builds and consulting with SNRE IT support staff.

I decided on an Intel Xeon server CPU processor over the desktop i7 CPU architecture because server motherboards offer a greater number of RAM slots (x 16) which can support 512-1024 GB with existing RAM cards. With my available budget I could only afford 256 GB of RAM (32 GB x 8), but have room to upgrade to 512 GB of the same RAM configuration in the future. 

UPDATE: There was an issue after we initially configured the computer with 128 GB RAM and waited for the delivery of our second set of 128 GB RAM. When we tried to install the second set of RAM cards the server motherboard lost all responsiveness. We went through a three week cycle of tracking down the issue by RMAing the various parts: first we tried replacing the motherboard, then the power unit (PSU), and finally isolated an individual RAM card which was non functional. Currently the workstation is running fine with the original 128 Gb RAM and we are waiting to receive replacement RAM and will test the system again. Fingers Crossed!

UPDATE 2: The issue was caused by a rogue stand-off without a mounting hole shorting the motherboard near the back corner by the RAM cards - it was removed and a new board installed with the full 256 GB RAM. We have also purchased two 960GB SSDs and an 8TB Seagate HDD for extra storage. 

Workstation 1 Parts list			Cost ($)
Tower			99.99
Motherboard			389.99
Xeon 8-core Dual CPUs			675.00 x 2 = 1350
ECC RAM (x 8)			273.99 x 8 = 2192.92
Video Card			689.99
SSD Hard Drives (x 2)			159.99 x 2 = 319.98
Power			169.99
Cooling			74.99 x 2 = 149.98
Seiki 42" 4k television (used as a monitor) 2 x 23" 1080p ACER monitors 2 desk arms (in kind) Logitech wireless mouse and keyboard (in kind)			309.99
Total			$5,672.83