16 Understand Spark Execution on Cluster

Video explains - How Spark executes JOB on Cluster? How Spark submits jobs in cluster env? What are different cluster manager available? What are different deployment mode on Cluster?

Chapters
00:00 - Introduction
00:26 - How Spark executes a JOB on cluster?
02:30 - Types of CLuster Manager
03:15 - Cluster Deployment Modes
09:56 - Spark Submit

Spark Documentation - https://spark.apache.org/docs/latest/...
Local PySpark Jupyter Lab setup -    • 03 Data Lakehouse | Data Warehousing ...  
Python Basics - https://www.learnpython.org/
GitHub URL for code - https://github.com/subhamkharwal/pysp...
https://github.com/subhamkharwal/pysp...

The series provides a step-by-step guide to learning PySpark, a popular open-source distributed computing framework that is used for big data processing.

New video in every 3 days ❤️

#spark #pyspark #python #dataengineering