Four EVGA 3090 NVLinked GPUs - Hephaestus Build

Over the course of years I slowly acquired these 3090s and at the end of last year bought a couple used 3090 Ti GPUs. I found that a couple of these were able to do pretty well when doing some machine learning (ML). I found there is around 20/25% boot when using an NVLink between cards. I am going to setup things with 2 1600W EVGA SuperNOVA Titanium power supplies. I show a little bit of Jupyter lab and notebooks. Then show how to tell if the GPUs are connected and NVLinked. While making this video I noticed the video memory on the 3090 Ti cards looked low. Seems the firmware may need updating since there’s clearly some thing with the cards showing the max VRAM. I moved the little switch on the cards to OC to use that version and all the 24GB of memory is now showing.

Timeline
00:00 - Two EVGA 3090 & Two EVGA 3090 Ti
02:59 - Four GPUs connected to the rig
06:10 - SSH to rig and talking a little about AI and my research
09:19 - nvidia-smi to look at GPUs and NVLinks
16:19 - 3090 Firmware oddities and 24GB of VRAM

EVGA GeForce GT 1030 SC - 02G-P4-6332-KR - Spec Sheet - https://www.evga.com/products/specs/g...
EVGA GeForce RTX 3090 FTW3 ULTRA - 24G-P5-3987-KR - Spec Sheet - https://www.evga.com/products/specs/g...
EVGA GeForce RTX 3090 Ti FTW3 ULTRA - 24G-P5-4985-RX - Spec Sheet - https://www.evga.com/products/Specs/G...
EVGA GeForce RTX NVLink SLI Bridge for RTX 3090 - 100-2W-0130-LR - Spec Sheet - https://asia.evga.com/products/produc...
EVGA SuperNOVA 1600W T2 80+ TITANIUM Power Supply - 220-T2-1600-X1 - Spec Sheet - https://www.evga.com/products/Specs/P...
EVGA SuperNOVA 1000W T2 80+ TITANIUM Power Supply - 220-T2-1000-X1 - Spec Sheet - https://drive.google.com/file/d/1EVmx...
Linkup PCIe 4.0 Ultra Straight Riser Cables - https://linkup.one/linkup.one/pcie-ri...