Long Context Windows: Extending Llama 3

Join us live to discover how Gradient AI is pushing the boundaries of LLM technology with groundbreaking long-context versions of Llama 3! We'll explore how Gradient's small team outpaced Meta by releasing Llama 3 models with unprecedented context windows, reaching up to 4 million tokens. Learn the technical intricacies of expanding context window sizes from 8B to 70B parameters, the compute requirements, and the challenges faced. We'll delve into popular benchmarks like Greg Kamradt’s Needle in a Haystack and discuss with Gradient's Chief Scientist, Leo Pekelis, the future of RAG versus long-context LLMs. Don't miss this chance to understand the cutting-edge advancements in AI and get your questions answered live.

Event page: https://lu.ma/longllama

Have a question for a speaker? Drop them here:
https://app.sli.do/event/9kSLiGTxM1Cz...

Speakers:
Leonid Pekelis, Chief Scientist at Gradient
  / leonid-pekelis  

Dr. Greg, Co-Founder & CEO
  / gregloughane  

The Wiz, Co-Founder & CTO
  / csalexiuk  

Apply for our new AI Engineering Bootcamp on Maven today!
https://bit.ly/aie1

For team leaders, check out!
https://aimakerspace.io/gen-ai-upskil...

Join our community to start building, shipping, and sharing with us today!
  / discord  

How'd we do? Share your feedback and suggestions for future events.
https://forms.gle/dRMWrwHM9kjGc4A97