THIS is NVIDIA's New AI GPU for up to 10,000 GPU Installations ft. Supermicro

The NVIDIA L40S is the company's do-it-all GPU that is for professional visualization, vGPU capabilities, and even AI inference and training. We use Supermicro SYS-521GE-TNRT 8-GPU system to take a look at the NVIDIA L40S vs. the NVIDIA H100 and vs. the NVIDIA A100 to see why this GPU is a different option for model customization, generative AI/ LLM applications, as well as for video.

Thanks to Supermicro and NVIDIA for getting us the hardware to make this possible and flying me out to California for a few hours.

STH Main Site Article: https://www.servethehome.com/nvidia-l...
STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09

----------------------------------------------------------------------
Become a STH YT Member and Support Us
----------------------------------------------------------------------
Join STH YouTube membership to support the channel:    / @servethehomevideo  

STH Merch on Spring: https://the-sth-merch-shop.myteesprin...

----------------------------------------------------------------------
Where to Find STH
----------------------------------------------------------------------
STH Forums: https://forums.servethehome.com
Follow on Twitter:   / servethehome  
Follow on LinkedIn:   / servethehome-com  
Follow on Facebook:   / servethehome  
Follow on Instagram:   / servethehome  

----------------------------------------------------------------------
Where to Find The Unit We Purchased
Note we may earn a small commission if you use these links to purchase a product through them.
----------------------------------------------------------------------
Supermicro eStore: https://shrsl.com/4dalw

----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction
01:29 NVIDIA SXM5 H100 GPUs versus PCIe and OAM
04:27 Heritage of NVIDIA PCIe GPUs for AI
05:18 NVIDIA L40 vs L40S
06:22 NVIDIA L40S L40 A100 H100 H100 NVL PCIe Comparison Table
12:00 Wrap-up