The Largest Mamba LLM Experiment Just Dropped

Check out HubSpot's ChatGPT at work bundle! https://clickhubspot.com/2os

A long awaited sequel in LLM research has appeared, AI21Labs has dropped the biggest Mamba experiment, which is on par with other open source LLM models! Just with a few twists...

Original Mamba Paper
[Paper] https://arxiv.org/abs/2312.00752
[Code] https://github.com/state-spaces/mamba

MambaFormer
[Paper] https://arxiv.org/pdf/2402.04248.pdf

AI21Labs
[Blog] https://www.ai21.com/blog/announcing-...
[Huggingface] https://huggingface.co/ai21labs/Jamba...
[NVIDIA NIM] https://nvda.ws/3Jn5pxb

VideoMamba
[Paper] https://arxiv.org/abs/2403.06977
[Code] https://github.com/OpenGVLab/VideoMamba

Special thanks to LDJ for helping out with the content in this video!

This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner

[Discord]   / discord  
[Twitter]   / bycloudai  
[Patreon]   / bycloud  

[Music] Massobeats - Lush
[Profile & Banner Art]   / pygm7  
[Video Editor] Silas

0:00 Intro
1:16 Hubspot
2:24 Jamba
8:08 VideoMamba