Using Apache Iceberg and Trino

Описание к видео Using Apache Iceberg and Trino

Apache Iceberg is the modern table format taking the big data world by storm, allowing increased functionality and improved performance on the data lake that rivals data warehouse functionality. At the same time, Trino is doing the same in the query engine world. This open source, high-performance SQL engine powers an increasing number of data platforms, with Starburst Galaxy leading the pack. Starburst Galaxy takes all of the raw power of Trino and Iceberg and packages it as an analytics platform that balances power, ease of use, and openness.

In this exciting exploration, we're delving into the powerful combination of Apache Iceberg and Trino, two dynamic tools reshaping the landscape of big data. To do this, we'll use Starburst Galaxy and compare its use to AWS Athena. Along the way, we'll make use of the metastore AWS Glue. One of the great things about using Iceberg, Trino, and Starburst Galaxy is that you can mix and match metastores, data sources, and table formats with ease. Using this dream team combination, you're able to access all of the power of Trino, all of the ease of use of Starburst Galaxy, and all of the advanced features of Apache Iceberg. This includes advanced table format enhancements like schema evolution, partition evolution, and time travel. Apache Iceberg handles metadata in a whole new way, allowing for these advanced features. Starburst Galaxy harnesses that power and openness, making it intuitive and easy to use.

Want to learn more? We have a great blog on the topic: https://www.starburst.io/blog/introdu...

#trino #apachetrino #iceberg #apacheiceberg #starburst #starburstgalaxy #datalakehouse #datalake #aws #azure #gcp #datawarehouse #icehouse #dataicehouse #deltalake #hudi #dataengineering #data #dataanalytics #techeducation #clouddatalakehouse #etl #etlpipeline #tableformat #hive #apachehive #opendata #opendatalakehouse #sql #bigdata #techdemo #technicaleducation #hadoop

Комментарии

Информация по комментариям в разработке