How is Beam Search Really Implemented?

Try Voice Writer - speak your thoughts and let AI handle the grammar: https://voicewriter.io

Beam search. You've probably heard of it, but there are surprising tricks to make it work in practice.

In this video, I walk through how beam search is implemented in the Huggingface transformers library. Find out what clever data structures are used to enhance the performance of this decoding technique!

0:00 - Introduction
1:11 - Review of Beam Search
2:56 - Hugging Face Code Walkthrough

Resources about beam search:
https://huggingface.co/blog/how-to-ge...

Huggingface source code:
https://github.com/huggingface/transf...

#BeamSearch #nlp #huggingface #ai #machinelearning #deeplearning