Arrow and Substrait: Better Together

Speaker: Ian Cook, Product Manager at Voltron Data

Links from the slides:

Substrait project: https://github.com/substrait-io/subst...

DSLs producing Substrait:
Python Ibis Substrait compiler: https://github.com/ibis-project/ibis-...
R dplyr Substrait compiler: https://github.com/voltrondata/substr...
SQL Substrait compiler (Isthmus): https://github.com/substrait-io/subst...

Engines consuming Substrait:
Apache Arrow C++ query engine (Acero): https://github.com/apache/arrow/tree/...
substrait
Apache Arrow DataFusion: https://github.com/apache/arrow-dataf...
Apache Arrow Ballista: https://github.com/apache/arrow-balli...
DuckDB: https://github.com/duckdb/duckdb/tree...

Other Substrait tooling:
Substrait validator: https://github.com/substrait-io/subst...
Format for better human-readable Substrait: https://github.com/saulpw/jsom

ADBC (Arrow Database Connectivity): https://docs.google.com/document/d/1t...

How to Stay Informed and Get Involved:
Apache Arrow community: https://arrow.apache.org/community
Substrait community: https://substrait.io/community
Voltron Data blog: https://voltrondata.com/news
Voltron Data on Twitter:   / voltrondata  
Voltron Data on LinkedIn:   / voltrondata