Joel Knighton – Under the hood of vector search with JVector

ANN (approximate nearest neighbor) vector search is totally different from the problems that we're used to solving with databases. You can't just throw a B-tree at it and call it a day.
It's a super young field with arguably the most important breakthrough (HNSW) created only eight years ago. The best commercial products have started to ship designs based on DiskANN, which is five years old.
Nobody really knows the best way to solve several important problems (how to build indexes larger than memory? how to partition across machines? How to combine indexes to ""garbage collect"" obsolete data without a full rebuild?)
The importance of ANN to RAG (retrieval augmented generation) in generative AI is supercharging interest in the field and we should expect the state of the art to advance quickly.

Speaker: Joel Knighton

More: https://2024.berlinbuzzwords.de/sessi...

###

Follow us on Social Media and join the Community!
Mastodon: https://floss.social/@berlinbuzzwords
LinkedIn:   / berlin-buzzwords  
Instagram:   / berlinbuzzwords  

Website: https://2024.berlinbuzzwords.de

Berlin Buzzwords is an event by Plain Schwarz – https://plainschwarz.com