Raspberry Pi Supercomputer for Quants | How to build a Raspberry Pi Cluster | SLURM Cluster Config

Today we are making a mini supercomputer! (Not really, but sort-of) We are building a 4-node raspberry pi cluster. On this cluster we will be installing a scheduler or workload manager called SLURM, although it may be overkill for a personal cluster.

For quants – quantitative financial analysts – the SLURM implementation will be most useful. With SLURM we can schedule, run, and control scripts to run across our compute nodes. We will setup a network file system (NFS) that can be shared across our cluster, this is installed on the master node.

In this tutorial, I go through all steps from building the cluster, flashing the microSD cards, enabling the NFS across nodes, all the way to loading SLURM on the cluster. We will be following three tutorials from Garrett Mills on Medium for installation on SLURM and enabling parallel computing using openMPI.

Building a raspberry pi cluster (Garrett Mills, 2018):   / building-a-raspberry-pi-cluster  

PuTTY (SSH Client): https://www.putty.org/

★ ★ QuantPy GitHub ★ ★
Collection of resources used on QuantPy YouTube channel. https://github.com/thequantpy

★ ★ Discord Community ★ ★
Join a small niche community of like-minded quants on discord.   / discord  

★ ★ Support our Patreon Community ★ ★
Get access to Jupyter Notebooks that can run in the browser without downloading python.
  / quantpy  

★ ★ ThetaData API ★ ★
ThetaData's API provides both realtime and historical options data for end-of-day, and intraday trades and quotes. Use coupon 'QPY1' to receive 20% off on your first month.
https://www.thetadata.net/

★ ★ Online Quant Tutorials ★ ★
WEBSITE: https://quantpy.com.au

★ ★ Contact Us ★ ★
EMAIL: [email protected]

Disclaimer: All ideas, opinions, recommendations and/or forecasts, expressed or implied in this content, are for informational and educational purposes only and should not be construed as financial product advice or an inducement or instruction to invest, trade, and/or speculate in the markets. Any action or refraining from action; investments, trades, and/or speculations made in light of the ideas, opinions, and/or forecasts, expressed or implied in this content, are committed at your own risk an consequence, financial or otherwise. As an affiliate of ThetaData, QuantPy Pty Ltd is compensated for any purchases made through the link provided in this description.