Advancing Spark - Delta Live Tables Merge!

The ability to upsert data is a fairly basic requirement, but it's been missing from the Delta Live Tables preview so far, with only append & complete re-write options available. The new Change Data Capture functionality unlocks the power of Merge with Delta, inside our DLT pipelines, so there's lots to be excited about!

In this video, Simon walks through the new features, takes a look at the syntax & some gotchas to be aware of, before looking at what actually happens to the delta tables under the hood!

For more info around DLT CDC, check out the docs here: https://docs.databricks.com/data-engi...

As always, get in touch with Advancing Analytics if you need that vital boost to your Data Lakehouse journey!