Airflow CI/CD: Github to Cloud Composer (safely)

Описание к видео Airflow CI/CD: Github to Cloud Composer (safely)

Jacob Ferriero


Deploying bad DAGs to your Airflow environment can wreak havoc. This talk provides an opinionated take on a mono repo structure for GCP data pipelines leveraging BigQuery, Dataflow and a series of CI tests for validating your Airflow DAGs before deploying them to Cloud Composer.

Комментарии

Информация по комментариям в разработке