6.05 Mastering end-to-end Synapse Warehouse Solution

   • Microsoft Fabric For Beginners  
In this video, I discuss the challenges of building end-to-end Synapse Warehouse solutions across different maturity zones (Bronze, Silver, Gold) and demonstrate practical solutions.
Chapters:
00:00- Introduction
00:55- Preview
05:01- Solution Architecture
08:07- Data Architecture
14:36- Demo-Data modelling tasks: creating tables, Primary Keys and Foreign Keys
14:53- Demo- Ingesting from Data Lake using Copy INTO command
16:49- Data engineering challenges- how to generate table-level unique ID values?
18:24- How to handle 'Merge INTO' Logic?
20:14- Demo: Using watermarking logic to generate unique values
21:12- Demo: How to normalize schema? Common Silver zone transformations- handling Null values, data type conversions, deduplication
26:19- Dimensional Modelling by Kimball -How to Handle Slowly -Changing Dimensions (SCD)?
34:17- How to handle date/ time dimensions?
37:35- Handling Fact/dimension links. What are late arriving dimensions?
41:17- How to handle Fact updates
44:38- How to build end-to-end orchestration pipeline?

You can download the demo artifacts here:
SQL Script: https://github.com/fazizov/youtube/bl...
Sample file: https://github.com/fazizov/youtube/bl...

Please subscribe:    / @fazizov  
Follow me on Linkedin: www.linkedin.com/in/fikrat-azizov-865a0528
and X: @fikrat_azizov

Official Documentation:
https://learn.microsoft.com/en-us/fab...
https://www.kimballgroup.com/data-war...

Hashtags:
#microsoftfabric ,#datawarehouse, #dataengineering, #azure,#microsoft,#cloudcomputing, #dataanalytics, #lakehouse, #azuretutorial, #azuretraining, #datapipeline, #dataextraction , #dataintegration, #datatransfer, #dataflow, #spark, #deltalake, #synapse, #synapsedataenginering, #demo, #datalake, #transformation, #ingested, #dataintegration, #azuredatabricks ,#databricks, #bigdata, #bigdatatechnologies, #sparksql, #notebook ,#transformationvideo, #bronze, #medallion , #modeling, #facts, #silver, #gold, #historical data, #incremental,#datafactory, #mirroring, #dimensions, #datamodeling