Complete Azure Data Engineering Project by Sumit Sir

Link to Ultimate Data Engineering Program by Sumit Sir - https://trendytech.in/ultimate-big-da...

Complete Azure Data Engineering Project by Sumit Sir

Github Link to the Datasets and reference code - https://github.com/bigdatabysumitm/Tr...

Azure Project Timestamps

00:00:00 - Introduction
00:03:23 - Problem Statement and Domain Overview
00:29:48 - Role of a Data Engineer in the Project
00:32:02 - Overview of Datasets
00:56:28 - Solution Architecture Breakdown
01:16:00 - Technologies Used in the Project
01:18:04 - step 1 - Azure Storage Account
01:26:27 - Pipeline Implementation Details
02:35:11 - Summary of the Full Load Process
02:37:03 - Pipeline Design for Incremental Load
02:50:31 - Challenges with the Current Pipeline
02:58:34 - Introduction to Part 2
03:04:07 - Conclusion and Final Thoughts

Technology - Azure Data Engineering Stack
Domain - Healthcare Revenue Cycle Management (RCM)

RCM is the process that hospitals use to manage the financial aspects, from the time the patient schedules an appointment till the time the provider gets paid..

In This Project will be heavily using Azure Databricks & Azure Data Factory.

We will be creating a metadata driven pipeline.

Links to understand the KPI's & understand more on Accounts Receivable

https://mdmanagementgroup.com/healthc...

https://gentem.com/blog/revenue-cycle...

DO not forget to like the video & share with your friends!