Microsoft Fabric: Ingesting 5GB into a Bronze Lakehouse using Data Factory - Part 3

Microsoft Fabric End to End Demo - Part 3 - Ingesting 5GB into a Bronze Lakehouse using Data Factory. In this video we'll see how we can quickly ingest ~5GB of data from an unauthenticated HTTP data source into #OneLake using #DataFactory in #MicrosoftFabric. We'll see the distinction between Tables and Files in a Fabric #Lakehouse and look at how we can preview data in the Lakehouse explorer.

00:00 Intro
00:15 Dataset recap
01:25 Workspace and pipeline artifacts
01:57 Pipeline UI layout
02:21 Copy data activity options
03:07 Configure copy data activity source
05:00 Configure copy data activity destination
06:21 Add dynamic content for destination Lakehouse filepath
08:21 Copy Data activity additional settings
09:00 Manually trigger pipeline
09:21 Alternative parameterized pipeline
11:38 Reviewing pipeline run details
12:10 Default workspace artifacts
13:04 Viewing Lakehouse Files
13:46 Roundup and outro

Useful links:
📂 Price Paid Data (PPD) in text or CSV format: https://www.gov.uk/government/statist...
📖 Data Factory in Microsoft Fabric: https://learn.microsoft.com/en-us/fab...
📖 Copy Data activity in Microsoft Fabric: https://learn.microsoft.com/en-us/fab...
📖 Lakehouse in Microsoft Fabric: https://learn.microsoft.com/en-us/fab...

Series contents:

📺 Part 1 - Lakehouse & Medallion Architecture -    • Microsoft Fabric: Lakehouse & Medalli...  
📺 Part 2 - Planning and Architecting a Data Project -    • Microsoft Fabric: Inspecting 28 MILLI...  
📺 Part 3 - Ingest Data -    • Microsoft Fabric: Ingesting 5GB into ...  
📺 Part 4 - Creating a shortcut to ADLS Gen2 in Fabric -    • Microsoft Fabric: Creating a OneLake ...  
📺 Part 5 - Navigating OneLake data locally -    • Microsoft Fabric: Local OneLake Tools  
📺 Part 6 - Role of the Silver layer in the Medallion Architecture -    • Microsoft Fabric: Role of the Silver ...  
📺 Part 7 - Processing Bronze to Silver -    • Microsoft Fabric: Processing Bronze t...  
If you want to learn more about Fabric, take a look at some of our other content:
📺 Part 8 - Good Notebook Development Practices -    • Microsoft Fabric: Good Notebook Devel...  

🤖 [Course] Microsoft Fabric: from Descriptive to Predictive Analytics:    • Microsoft Fabric: Machine Learning Tu...  
👉 Perspectives on #MicrosoftFabric: https://endjin.com/what-we-think/talk...
👉 A Tour Around #MicrosoftFabric: https://endjin.com/what-we-think/talk...
👉 Introduction to #MicrosoftFabric: https://endjin.com/blog/2023/05/intro...

and find all the rest of our content here: https://endjin.com/blog/2023/05/micro...

#Microsoft #PowerBI #MicrosoftFabric #lakehouse #datalake #onelake #data #datafactory #datapipline #ai #analytics #medallion #bronze #silver #gold #datafactory #projectplanning #hmrc #dataingestion