CI/CD for Modern Data Engineering | End to End Data Engineering Project

FULL COURSE AVAILABLE HERE (Mastering Terraform IaC on Azure: Practical Hands-on): https://www.datamasterylab.com/home/c...

In this video, we delve deep into the world of DevOps, focusing on Continuous Integration (CI) and Continuous Deployment (CD) within the realm of modern data engineering.

Timestamps:
0:00 Introduction
2:00 System architecture
4:00 Prerequisites and installations
9:21 Azure Infrastructure as Code Automation with Terraform
13:50 Storage account module with Terraform
32:52 Automating Azure Data Factory with Terraform
1:04:30 Testing and Validation of Results
1:09:14 Outro

Resources:
Medium Article:   / ci-cd-for-modern-data-engineering  
Github Code: https://github.com/airscholar/cicd_fo...
Terraform installation: https://developer.hashicorp.com/terra...
Azure CLI installation: https://learn.microsoft.com/en-us/cli...

Tags:
CI/CD, Data Engineering, Azure, Terraform, DevOps, Cloud Computing, Continuous Integration, Continuous Deployment, Azure DevOps, Infrastructure as Code, Automation,Cloud Services, Azure Cloud, Terraform Automation, Data Pipeline

Hashtags:
#CICD #DataEngineering #Azure #Terraform #DevOps #CloudComputing #ContinuousIntegration #ContinuousDeployment #AzureDevOps #InfrastructureAsCode #Automation #CloudServices #AzureCloud #TerraformAutomation #DataPipeline #DevSecOps