Скачать или смотреть Essential Pillars For Building LLM Applications For Production with You.com

Zairah Mustahsan, Data Scientist, You.com

Abstract:
Large Language Models (LLMs) are becoming increasingly popular, particularly for search and summarization tasks. However, they also come with unique challenges. While creating something impressive with LLMs is easy, making something production-ready is much more difficult. In this talk, we will discuss the challenges and key lessons we learned while developing powerful applications with LLMs. We will cover systematic prompt engineering, versioning, optimization, and trade-offs between cost, latency, and performance. Additionally, we will review specific use cases and explore how to maximize the potential of LLMs using vector databases.

Whether you're a seasoned machine learning expert or just starting out, this talk will provide valuable insights into the process of productionizing LLM applications.