Скачать или смотреть vLLM Office Hours #19 - Multimodal LLMs With vLLM v1 - February 6, 2025

Join us for a recap of our vLLM Office Hours session where we dove deep into the exciting new multimodal capabilities in vLLM v1!

We started with an update on vLLM v0.7.0 and v0.7.1, highlighting the latest features and improvements, including recent DeepSeek model support, call for v1 testing, and much more.

Then, we jumped into the core topic: Multimodal LLMs with vLLM v1. We explored the major architectural changes that enable multimodality, walked through the input processing pipeline, and explained the intricacies of the new caching system designed to handle multimodal data. We also shared valuable learnings and benchmark results showcasing the performance of vLLM v1's multimodal features. Finally, we offered a sneak peek into the future roadmap, discussing upcoming developments like multimodal output (image generation) support.

Timestamps:

-New vLLM Blogs Worth Checking Out: 9:24
-What's New in vLLM v0.7.0: 10:41
-What's New in vLLM v0.7.1: 14:55
-Multimodal LLMs in vLLM v1: 19:55
-Overview of Large Multimodal Models: 21:23
-What Did We Learn About Multimodal Models in vLLM v0: 22:22
-vLLM v1 - Encoder Cache & Encoder-Aware Scheduler: 26:05
-vLLM v1 - Prefix Caching: 30:18
-vLLM v1 - Multimodal Data Processing: 32:20
-vLLM v1 - Optimized Engine Loop: 33:40
-vLLM v1 - Multimodal Feature Caching: 34:35
-Benchmarks - Online Serving: 37:34
-Benchmarks - Offline Inference: 38:41
-Future Work: 40:41
-Open Discussion and Audience Q&A: 44:06
-Get Involved With the vLLM Community: 59:16

Session slides: https://docs.google.com/presentation/...

Join our bi-weekly vLLM Office Hours to learn about the latest features and updates: https://hubs.li/Q02Y5Pbh0

#vLLM #Multimodal #LLM #AI #MachineLearning #vLLMOfficeHours #vLLMv1