Why Evals Matter | LangSmith Evaluations - Part 1

Описание к видео Why Evals Matter | LangSmith Evaluations - Part 1

With the rapid pace of AI, developers are often faced with a paradox of choice: how to choose the right prompt, how to trade-off LLM quality vs cost? Evaluations can accelerate development with structured process for making these decisions. But, we've heard that it is challenging to get started. So, we are launching a series of short videos focused on explaining how to perform evaluations using LangSmith.

This video lays out 4 main considerations for evaluation: (1) dataset, (2) evaluator, (3) task, (4) how to apply evaluation to improve your product (e.g., unit tests, A/B tests, etc).

Getting started documentation:
https://docs.smith.langchain.com/eval...

Комментарии

Информация по комментариям в разработке

Похожие видео