Analytics Engineers Develop a Fabric Data Lakehouse in 15 Minutes - DevDash

Welcome to DevDash! For today's episode, Austin and Manuel must develop a Data Lakehouse in just 15 minutes.

Next step on your journey:

👉 On-Demand Learning - Start With The FREE Community Plan: https://prag.works/odl-trial-yt

🔗Pragmatic Works On-Demand Learning Packages: https://pragmaticworks.com/pricing/
🔗Pragmatic Works Boot Camps: https://pragmaticworks.com/boot-camps/
🔗Pragmatic Works Hackathons: https://pragmaticworks.com/private-tr...
🔗Pragmatic Works Virtual Mentoring: https://pragmaticworks.com/virtual-me...
🔗Pragmatic Works Enterprise Private Training: https://pragmaticworks.com/private-tr...
🔗Pragmatic Works Blog: http://blog.pragmaticworks.com/

Let's connect:

✔️Twitter: https://prag.works/yt-twitter
✔️Facebook: https://prag.works/yt-fb
✔️Instagram: https://prag.works/yt-insta
✔️LinkedIn: https://prag.works/yt-li
✔️Discord: https://prag.works/yt-discord

Pragmatic Works
7175 Hwy 17, Suite 2 Fleming Island, FL 32003
Phone: (904) 638-5743
Email: [email protected]
#pragmaticworks

18:16 Running the solution
21:53 Announcing the winner
23:12 Outro

00:00 Intro
01:22 Explanation of the Task
03:01 Austin's Approach with Spark Notebook
04:16 Manuel's Approach with PowerBI and Pipelines
06:33 Initial Steps and Setup by Both Competitors
08:22 Creating Shortcuts and Connecting to Data
10:06 Austin's Data Transformation Using PySpark
12:33 Manuel's Dynamic Pipeline Design
14:21 Setting Up Data Flows and Cleaning Customer Table
16:14 Writing Data to Lakehouse and Final Adjustments
18:16 Running and Testing the Solutions
21:00 Comparison of Execution Times
21:53 Announcing the winner
23:12 Outro