Скачать или смотреть What It Actually Takes to Deploy GenAI Applications to Enterprises Custom Evaluation Models

Speaker:
Alexander Kvamme, CEO, Echo AI
Arjun Bansal, CEO & Co-founder, Log10

Alexander Kvamme and Arjun Bansal will share Echo AI's journey in deploying their conversational intelligence platform to billion-dollar retail brands. They will discuss the challenges faced due to LLM accuracy issues, which impacted their ability to deploy at scale. The speakers will speak about the iterative prompt engineering process and the collaborative workflow needed to optimize prompts and boost accuracy to production-ready levels.

Additionally, they will highlight the importance of an end-to-end LLMOps workflow, like the one provided by Log10, which enabled Echo AI engineers to efficiently resolve accuracy issues and scale enterprise customers to production. The discussion will also cover the role of AI-powered assistance, such as Log10's Prompt Engineering Copilot, in systematically improving accuracy and helping solution engineers handle a 10x influx of customers without increasing team size.

Furthermore, the speakers will address the infrastructure requirements for successfully deploying a conversational intelligence platform at enterprise scale, including logging, tagging, debugging, prompt optimization, feedback, fine-tuning and seamless integration with existing AI tech stack and developer tooling.