Скачать или смотреть Deploying Dagster on EC2 with Docker Compose – Production-Ready and CI/CD Enabled

Setting up a Dagster deployment doesn’t have to mean spinning up a Kubernetes cluster or using complex infrastructure. In this video, I walk you through how to run open-source Dagster on an EC2 instance using Docker Compose, with a focus on achieving seamless continuous deployment and operational excellence.

What you’ll learn:
• The truth about the dagster dev CLI (and why it’s not for prod)
• Why traditional CD on VMs can be tricky
• How Dagster’s architecture makes lightweight deployments possible
• How to set up CI/CD for Dagster with zero downtime
• Considerations for Dagster Plus and when it’s worth it
• Real-world tips for deploying Dagster in on-prem or resource-constrained environments

--------------
Chapters:

0:00 intro
0:34 Dagster deployment options
1:33 How dagster dev command works
3:23 Ephemeral and Persistent Dagster Deployments
8:00 Deploying with dagster dev
11:14 Required components for production deployment
15:18 Production deployment code walkthrough
17:38 Zero downtime CI/CD
21:52 Dagster CI/CD pipeline walkthrough
25:08 How to plan for a production deployment
29:55 Outro
--------------

Whether you’re a data engineer working solo, part of a small team, or deploying on-prem, this setup is for you.


Dagster deployment documentation: https://docs.dagster.io/guides/deploy...

GitHub Repo (Docker Compose setup + CD script): https://github.com/JesuFemi-O/dagster...

🎥 Don’t forget to like, comment, and subscribe if you found this helpful!