Скачать или смотреть Uwe Schindler – State of native access in Apache Lucene

More: https://2025.berlinbuzzwords.de/sessi...

Speaker: Uwe Schindler

Lucene 10 came out last year in October. One of the changes was about the minimum version requirement of Java 21 – this looks like it allows to introduce new features like native access to file system cache and therefore better memory mapping. Is it as easy as it sounds?

This talk will discuss the new features of Java 21 and how they can be used in Lucene 10. But it will also show the challenges that come from the fact that the many of the Lucene-relevant APIs are preview-only in that version.
Uwe will introduce the mechanisms used to provide access to the native layer of Java 21 but also the limitations. New features implemented using native APIs are `madvise`/`fadvise` kernel hints for the file system, but also preloading of pages required during search.
The limitations of the current system make it impossible to integrate modern Java APIs into the public API of Lucene, so Lucene 10 still has the same limitations like previous versions with regards to Java preview features. Discussions are ongoing to change the main branch to align to the "[tip & tail](https://openjdk.org/jeps/14)" model of development done in the OpenJDK community and start to integrate types like `MemorySegment` as first class citizen to Lucene's public API in the main (development) branch and release new versions with new minimum requirements more often. One example for this is a PR to offload calculations to a graphics card which was submitted to the Lucene project at the time of writing this proposal.

###

Follow us on Social Media and join the Community!

Mastodon: https://floss.social/@BerlinBuzzwords
LinkedIn:   / berlin-buzzwords  
Website: https://berlinbuzzwords.de
Mail: [email protected]

Berlin Buzzwords is an event by Plain Schwarz – https://plainschwarz.com