Microsoft Fabric: Good Notebook Development Practices 📓 (End to End Demo - Part 8)

Microsoft Fabric End to End Demo - Part 8 - Good Notebook Development Practices

Notebooks can very easily become a large, unstructured dump of code with a chain of dependencies so convoluted that it becomes very difficult to track lineage throughout your transformations. With a few simple steps, you can turn notebooks into a well-structured, easy-to-follow repository for your code.

In this video, we take a look at a few good practices when working with notebooks as a primary artifact type in your code-base. We'll look at things like using commentary within your notebooks, achieving modularization by structuring your logic into separate classes and functions, and defining "schemas as code" to be explicit about the data you're reading and writing.

00:00 Intro
00:12 Principles underpinning good notebook development
00:56 Methods to achieve good notebook development
02:27 Workspace artifact folder structure
05:27 Notebook structure demo - Commentary
06:19 Defining classes and functions
08:47 Consuming classes and functions - magic commands
09:36 Defining schemas as code
12:05 Consuming schemas when creating Delta tables
13:05 Roundup & Outro

Useful links:

📖 Develop, execute, and manage Microsoft Fabric notebooks: https://learn.microsoft.com/en-us/fab...
📖 Create folders in workspaces (preview): https://learn.microsoft.com/en-us/fab...

Series contents:

👉 Part 1 - Lakehouse & Medallion Architecture -    • Microsoft Fabric: Lakehouse & Medalli...  
👉 Part 2 - Planning and Architecting a Data Project -    • Microsoft Fabric: Inspecting 28 MILLI...  
👉 Part 3 - Ingest Data -    • Microsoft Fabric: Ingesting 5GB into ...  
👉 Part 4 - Creating a shortcut to ADLS Gen2 in Fabric -    • Microsoft Fabric: Creating a OneLake ...  
👉 Part 5 - Navigating OneLake data locally -    • Microsoft Fabric: Local OneLake Tools  
👉 Part 6 - Role of the Silver layer in the Medallion Architecture -    • Microsoft Fabric: Role of the Silver ...  
👉 Part 7 - Processing Bronze to Silver -    • Microsoft Fabric: Processing Bronze t...  
👉 Part 8 - Good practices for Notebooks in Fabric - THIS VIDEO!
👉 Part 9 - Projecting Silver to Gold - COMING SOON!

If you want to learn more about Fabric, take a look at some of our other content:

👉 Perspectives on #MicrosoftFabric: https://endjin.com/what-we-think/talk...
👉 A Tour Around #MicrosoftFabric: https://endjin.com/what-we-think/talk...
👉 Introduction to #MicrosoftFabric: https://endjin.com/blog/2023/05/intro...

and find all the rest of our content here: https://endjin.com/blog/2023/05/micro...

#Microsoft #PowerBI #MicrosoftFabric #lakehouse #datalake #onelake #data #analytics #medallion #bronze #silver #gold #notebooks #coding #jupyternotebook