Flexible Scheduling with Automation in Data Engineering (A Dagster Deep Dive)

Data Engineering is all about automation, and the smarter your toolset, the more you can automate and the more you can optimize.

In this session, Pedram Navid, head of developer relations and analytics at Dagster Labs, shares insights into how to use Dagster's flexible scheduling options to automate and optimize your data platform.

You can join future sessions and catch past sessions here: https://dagster.io/events/dagster-dee...

You will find the Dagster repo for these sessions here: https://bit.ly/DagDemo
Be sure to bookmark (star) the Dagster repo for future reference: https://github.com/dagster-io/dagster

00:00 Introduction to Automation
03:12 Schedules
04:35 Sensors
06:40 Auto-materialize policies
07:24 What we will build - our sample project and demo
23:30 Questions