Скачать или смотреть How To Build A Data Platform 7 - Data Pipelines

Data pipelines are basically the plumbing of modern analytics: how do you get data from “raw” to “curated” without everything breaking at 2am?

In this video we break down what a data pipeline actually is, why most teams should default to ELT (not ETL), and how DAGs and orchestrators (like Airflow, Dagster, Prefect, and more) keep your workflows running reliably at scale. We’ll also cover the reality that some pipelines are effectively ELTEL (hello Power BI / Tableau), when ETL still makes sense, and how cheaper storage + columnar formats like Parquet changed the game.

Then we wrap with practical best practices to make pipelines boring (in the best way): retries, alerting, logging, version control, small testable steps, parameterisation, data quality checks, and timeouts.

If you’re building anything from dashboards to analytics platforms, this is the mental model you want.

Link to the guide here: https://weareoakland.com/the-ultimate...