Microsoft Fabric Spark Notebook - Learn PySpark and SparkSQL in 2hr(Beginners Course)

Microsoft Fabric End to End Solution - PySpark and SparkSQL Full Course For Beginners

Note:- Download the whole folder

Dataset and Code Link- https://1drv.ms/f/s!Ak57yG1_Qg0iey_2D...

---- Video Outline ----

0:01 Introduction
0:15 Loading File From You Local System to Lakehouse
1:40 Reading CSV File Using PySpark in Microsoft Fabric Notebook
4:02 Select and SelectExpr Function in PySpark
7:30 WithCoumn, WithColumns and WithColumnRenamed Function in PySpark
13:02 Where and Filter Function in PySpark
15:38 GroupBy and Aggregation Function in PySpark
19:45 Joining Two Dataframes Using PySpark
25:34 Union and UnionByName in PySpark
32:06 Drop, DropDuplicates and Distinct Function in PySpark
40:17 Write/Load data to a delta Table and Parquet File Using PySpark
45:16 Overwrite, Append , Ignore and Error Write Mode in PySpark
53:40 Create Delta Table and Load Data through Dataframe in PySpark
01:00:34 Create Delta Table with Partition and Load Data into it Using Dataframe in PySpark
01:10:57 Difference Between Managed and External Table
01:19:34 Create delta table using SparkSQL
01:23:15 Create delta table with Partition using SparkSQL and Insert Data from a View
01:28:48 DML Operations over a delta table using SparkSQL
01:34:17 Temporary and Global Reporary View in PySpark
01:38:32 Data Transformation Over a delta table using SparkSQL
01:50:01 Reading Delta table using PySpark and SparkSQL

Microsoft fabric data pipeline script activity:    • 03 Microsoft Fabric Data Pipeline: Cr...  

Microsoft Fabric data Lakehouse end to end project -    • 003 Microsoft Fabric Lakehouse: Lakeh...  

If you want to know more about Microsoft Fabric data Warehouse, Please watch below videos-
1. Create Microsoft Fabric Data warehouse:    • 001 Microsoft Fabric Data Warehouse: ...  
2. load data into Microsoft Fabric data warehouse using Data Pipeline:    • 02 Microsoft Fabric Data Warehouse: H...  
3. Create table in Microsoft Fabric data warehouse:    • 003 Microsoft Fabric Data Warehouse: ...  
4. load data into Microsoft Fabric data warehouse using Copy into Command:    • 003 Microsoft Fabric Data Warehouse: ...  
5. Transform and load data into Microsoft Fabric data warehouse using T-SQL Procedure -    • 004 Microsoft Fabric Data Warehouse: ...