GenAI on the Edge Forum: Running an LLM on a Raspberry Pi

Описание к видео GenAI on the Edge Forum: Running an LLM on a Raspberry Pi

Running an LLM on a Raspberry Pi
Pete WARDEN, CEO, Useful Sensors

Large language models like ChatGPT are a great fit for edge devices, but it can be hard to figure out how to get started running them outside of the cloud. In this talk Pete will cover the basics of deploying an open source LLM on a Raspberry Pi 5, explaining some of the options and tradeoffs involved, and discuss the use cases that this sort of system can support. He’ll also discuss what customer problems these models can help with, and how to ensure the inevitable hallucinations don’t pose a safety risk!

Комментарии

Информация по комментариям в разработке