Learn Together: Use Apache Spark in Microsoft Fabric

Full series information: https://aka.ms/learnlive-microsoft-fa...

More info here: https://aka.ms/learnlive-microsoft-fa...

Follow on Microsoft Learn:

Complete the Learn module: https://aka.ms/learnlive-20240124B

Apache Spark is a core technology for large-scale data analytics. Microsoft Fabric provides support for Spark clusters, enabling you to analyze and process data in a Lakehouse at scale.

---------------------

Learning objectives

Configure Spark in a Microsoft Fabric workspace
Identify suitable scenarios for Spark notebooks and Spark jobs
Use Spark dataframes to analyze and transform data
Use Spark SQL to query data in tables and views
Visualize data in a Spark notebook

---------------------

Chapters
--------
00:00 - Introduction
06:07 - Learning objectives
11:56 - Prepare to use Apache Spark
15:11 - Demo - Spark configuration
24:33 - Run Spark code
30:46 - Load data into a Spark dataframe
36:21 - Transform data in a dataframe
59:43 - Save a dataframe
1:13:33 - Work with data using Spark SQL
1:17:02 - Demo - Use Spark SQL
1:26:29 - Summary and resources

---------------------

Presenters

Anupama Natarajan
Data And Ai Consultant, Microsoft MVP
Pearl Innovations Limited
LinkedIn:   / anupamanatarajan  

Armando Lacerda
Azure Data Architect And Engineer, Microsoft MVP, Microsoft Super User
MC Tech
LinkedIn:   / armando-lacerda  

Moderators

Andrei Khaidarov
Senior Bi Engineer, Microsoft Super User
Velvetech LLC
LinkedIn:   / andgenn