Скачать или смотреть Zeta-Alpha-E5-Mistral: Finetuning LLMs for Retrieval (with Arthur Câmara)

In the 30th episode of Neural Search Talks, we have our very own Arthur Câmara, Senior Research Engineer at Zeta Alpha, presenting a 20-minute guide on how we fine-tune Large Language Models for effective text retrieval. Arthur discusses the common issues with embedding models in a general-purpose RAG pipeline, how to tackle the lack of retrieval-oriented data for fine-tuning with InPars, and how we adapted E5-Mistral to rank in the top 10 on the BEIR benchmark.

This episode was part of the OpenSearch Amsterdam Meetup group. Join us for the next edition: https://meetup.com/opensearch-project...

Subscribe to the Zeta Alpha calendar to not miss out on any of our events: https://lu.ma/zeta-alpha

Sources
InPars
https://github.com/zetaalphavector/In...
https://dl.acm.org/doi/10.1145/347749...
https://arxiv.org/abs/2301.01820
https://arxiv.org/abs/2307.04601
Zeta-Alpha-E5-Mistral
https://zeta-alpha.com/post/fine-tuni...
https://huggingface.co/zeta-alpha-ai/...
NanoBEIR
https://huggingface.co/collections/ze...