Advancing Spark - Local Development with Databricks Connect V2

We've all gotten rather used to developing in the browser and simply accepting the lack of local debugging, variable inspection and the niceties of software engineering... but not for much longer! Databricks have recently released Databricks Connect V2, based on the new open Spark Connect API. This allows us to run code locally, on a cluster inside our Databricks workspace!

In this video Simon walks through how Databricks Connect V2 can be used, either in a pure, standalone python environment, or with some extra goodies via the Databricks VSCode Extension!

To run through the plotly demo yourself, check it out here: https://github.com/databricks-demos/d...

Finally, if you're interested with hands-on Spark Training, check out our online platform: https://advancinganalytics.teachable....