Data Topic Deep Dive: Execution Engine V2 (Project Swordfish)

Introducing Project Swordfish, our new local execution model designed to deliver faster and more memory efficient execution. This streaming, push based engine is still a work in progress, but in this video, we show that Swordfish has already shown more than 2x improvements in both speed and memory usage for more than half of the TPCH benchmark queries.

Be sure to add our Monthly Contributor Sync to your calendar! https://bit.ly/DaftContributorSync

‣ Learn more about Daft: https://www.getdaft.io/
‣ Join our Distributed Data Slack Community: https://join.slack.com/t/dist-data/sh...
‣ Star Daft Github: https://github.com/Eventual-Inc/Daft
‣ Subscribe & stay in the know with Daft Engineering Blog: https://blog.getdaft.io/