Скачать или смотреть Refactoring Apache Spark to Allow Additional Cluster Managers - Kevin Doyle (IBM)

Apache Spark has 4 main open source cluster managers: Mesos, YARN, Standalone, and Kubernetes. Every cluster manager has its own unique requirements and differences. In order to support the scheduling engine in IBM Spectrum Conductor it required modifications to some core pieces of Spark. In this presentation we will walk you through the changes we worked with the community to allow Spark to be more pluggable. Which allowed us to avoid requiring modifying core Spark files to support the Enterprise Grid Orchestrator scheduling engine for every Spark version.

About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business.
Read more here: https://databricks.com/product/unifie...

Connect with us:
Website: https://databricks.com
Facebook:   / databricksinc  
Twitter:   / databricks  
LinkedIn:   / databricks  
Instagram:   / databricksinc   Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-nam...