Local HPC clusters continue to play a vital role in scientific research. However, setting up those systems can be very painful. If you just want to play around with the different systems, spending several hours until you can submit your first job is a very bleak outlook. Therefore, I present copy-paste ready instructions for setting up SGE, PBS/TORQUE, or SLURM on a single machine, which will act as the master and a compute node at the same time. All guides are tested on Ubuntu 18.04, but should work with little modification on most recent Linux installations.
In my opinion, Linux is the best operating system for a software engineer, except they develop explicitly for Windows or macOS. Still, as with any other operating system, optimizing a Linux workstation for software development requires some configuration. In this post, I will present tools and concepts that I think are very helpful, but overlooked by many.
In this post, I outline how I develop and run this blog site. I briefly explain my technology choices and give detailed instructions about how to use the resulting stack to create such a project. If you stick with me until the end, you will know how to run a beautiful, easily customizable static website for free.
AWS ParallelCluster is a toolkit for automating the process of building, configuring, and managing clusters of virtual machines on the Amazon Elastic Compute Cloud (EC2) cloud. These clusters can be used similar to traditional HPC clusters. This post contains a short performance analysis based on literature study and provides detailed instructions for getting started with your first cloud cluster.