Master Databricks and Apache Spark Step by Step: Lesson 16 - Using SQL Window Functions

In this video, you learn how to use Spark Structured Query Language (SQL) window functions. Spark SQL is the most performant way to do data engineering on Databricks and window functions expand SQL functionality to include things like cumulative totals, ranking values, and including aggregations alongside detail rows. They can save you a lot of work. I'll explain the concepts and demonstrate them with code in a Databricks notebook.

Get my book Master Azure Databricks Step by Step at
https://www.amazon.com/Master-Azure-D...

Example Notebook for lesson 16 at:
https://github.com/bcafferky/shared/b...

You need to unzip the file and import the notebook into Databricks to run the code.


Video on Creating and Loading the tables used in this video
   • Видео