Скачать или смотреть Beyond Zstandard: The Future of Data Compression - Yann Collet, Meta

Join us at the premier vendor-neutral open source conference, where developers and technologists come together to collaborate, share knowledge, and explore the latest innovations and advancements in open source technology. Learn more at https://events.linuxfoundation.org/

Beyond Zstandard: The Future of Data Compression - Yann Collet, Meta

Ten years after Zstandard re‑defined general‑purpose lossless compression, conventional algorithmic tweaks now deliver only single‑digit ratio improvements at ever‑steeper CPU costs.

We present OpenZL, which breaks the stalemate, by modeling a compressor as a dynamically configurable graph of proven building blocks. The result matches—or surpasses—the compression ratios of domain‑specific codecs while sustaining higher throughput, all backed by a single universal decoder and a unified, security‑hardened code base.
In this talk we will:

1. Explain the design and graph architecture, how the optimizer assembles blocks into an efficient, dataset‑specific compressor.

2. Present benchmark results on columnar, serialization schemas, floating point and binary‑blob workloads, showing ratio and speed versus Zstandard and specialized codecs.

3. Discuss operational wins—one package to ship, flexible deployment knobs, private extensions, and simplified auditing and maintenance.

4. Outline the open specification roadmap and invite Linux Foundation members to shape the 1.0 release.