Supercharge Your AI Platform with KubeRay: Ray + Kubernetes - Archit Kulkarni & Winston Chiang

Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon Europe in Paris from March 19-22, 2024. Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at https://kubecon.io

Supercharge Your AI Platform with KubeRay: Ray + Kubernetes - Archit Kulkarni, Anyscale & Winston Chiang, Google

One of the biggest challenges practitioners encounter in their Machine Learning (ML) and large language models (LLMs) journey is scaling up their training and inference workloads. Ray is a unified framework for scalable AI and scalable Python which has been a gamechanger for the ML ecosystem, and it’s been used to train the largest language models. The KubeRay operator enables native support for Ray applications on Kubernetes (K8s) infrastructure. Many leading AI organizations are standardizing their ML infrastructure by using KubeRay to deploy Ray on K8s. In this talk, we will share how KubeRay can accelerate your AI team. You will walk away with: - insights about the benefits of Ray and K8s to ML/AI platforms - guidance to build a performant and cost-effective platform with OSS tools, like AI leaders such as Uber, Shopify, and OpenAI - solutions for scaling your ML and LLM workloads with Ray Serve on K8s - how KubeRay integrates Ray into your existing K8s architecture