Deploy WEKA+Slurm-GCP on Google Cloud with Cluster-Toolkit

This talk will motivate the need to cleanly integrate the WEKA parallel filesystem with Slurm-GCP to enable AI/ML and HPC workloads on Google Cloud. By using the cluster-toolkit from Google Cloud, we’ll demonstrate how we can provide infrastructure-as-code to integrate WEKA with Slurm on Google Cloud in a manner consistent with WEKA’s best practices. We will present a free and open-source Cluster-Toolkit module from Fluid Numerics through a hands-on demonstration where we deploy an auto-scaling Slurm cluster with a parallel WEKA filesystem on Google Cloud.

Resources
Cluster Toolkit - https://github.com/GoogleCloudPlatfor...
Slurm+WEKA Integration guide : https://docs.weka.io/4.2/best-practic...
Fluid Numerics : https://www.fluidnumerics.com/services