Скачать или смотреть Introducing Fermyon Serverless AI - Execute inferencing on LLMs with no extra setup

With Fermyon Serverless AI you can now execute inferencing on Large Language Models (LLMs) for Llama2 and CodeLlama models on state-of-the-art GPUs with no extra setup. Watch this video to learn more and how to get started.

00:00 Welcome
00:10 Generative AI & Large Language Model (LLM)
00:50 Putting LLM functionality in Fermyon's Serverless Framework
01:00 LLM functionality in your source code (alongside HTTP Request & Responses, Key-Value Stores and NoOps Databases)
01:33 Using Fermyon Serverless AI in Fermyon Cloud

AI Inferencing performs well on GPU infrastructure. However, the demand for GPUs is high; GPUs are scarce and expensive. Fermyon Serverless AI has solved this problem by offering 50 millisecond cold start times, over 100x faster than other on-demand AI infrastructure services. Fermyon Serverless AI (which is in private beta) brings a new tool to the full-stack developer’s toolbox. You can combine Fermyon’s NoOps SQL Database and Key-Value Storage to quickly build advanced AI-enabled serverless applications.

Sign up for private beta at https://developer.fermyon.com/cloud/s...

#ai #llm #serverless #genai