Advancing Spark - Databricks Delta Streaming

It can be hard to build processes that detect change, filtering for rows within a window or keeping timestamps/watermarks in separate config tables. Delta Streaming allows you to write a streaming query over a delta table, whether it was streamed to or not, and automatically keep track of updates & change.

In this video, Simon walks through the basics of streaming with Delta and shows a couple of tips & tricks from his time working with realtime & batch streaming processes!

For more info about Delta Streaming, check out: https://docs.databricks.com/delta/del...

As always, don't forget to like and subscribe, and check out how we can help you master Databricks - https://www.advancinganalytics.co.uk/...