Data Engineer Project: An end-to-end Airflow data pipeline with BigQuery, dbt Soda, and more!

Data Engineer Project: An end-to-end Airflow data pipeline with BigQuery, dbt Soda, and more!

🏆 BECOME A PRO WITH AIRFLOW: https://www.udemy.com/course/the-comp...

In the Retail data pipeline project, you will learn:
➡️ How to create a data pipeline in Airflow from scratch
➡️ How to set up your Airflow local environment with the Astro CLI
➡️ How to run data quality checks in your pipeline with Soda
➡️ How to integrate dbt and run your models with Airflow and Comos
➡️ How to isolate tasks to avoid dependency conflicts
➡️ How to upload a CSV file into Google Cloud Storage
➡️ How to ingest data into a BigQuery table using the Astro SDK
and more!

This a complete 1hr project just for you ❤️

Here are the steps with the code snippets:
https://robust-dinosaur-2ef.notion.si...

Fasten your seatbelt, take a deep breath, and.... let's go!