Скачать или смотреть Build a Custom Estimator in Pyspark

In this video we will cover how to build a Custom Estimator in Pyspark. We will cover what Estmators are, why we should use them, and how they can be implemented, and incorporated, into Pyspark pipelines.

The break-down of the video is as follows:

Introduction 00:00
Jupyter Notebook Setup 00:51
Coding an Estimator in Pyspark 03:38
Testing in a Pipeline 15:13
Write & Load from Disk 18:27
Conclusions 20:25

The best way to keep up-to-date with my video/blog content is to sign up for my monthly Newsletter! Please visit: https://insidelearningmachines.com/ne... to register.

The notebook presented here can be found at:
https://github.com/insidelearningmach...

Notebooks dedicated to Pyspark Pipelines and Transformers can be found here:
https://github.com/insidelearningmach...
https://github.com/insidelearningmach...

My previous videos on Pipelines and Transformers can be found here:
   • Introduction to Pyspark Pipelines  
   • Build a Custom Transformer in Pyspark  

This video is based off of an article on my blog. You can find that blog article here: https://insidelearningmachines.com/cu...

The homepage of my blog is: https://insidelearningmachines.com

Other social media includes:
Twitter:   / inside_machines  
Facebook:   / inside-learning-machines-112215488183517  

#machinelearning #datascience #apache-spark #pyspark #insidelearningmachines