Advancing Spark - Manual Lineage with the Purview PyApacheAtlas API

Описание к видео Advancing Spark - Manual Lineage with the Purview PyApacheAtlas API

There's a whole lot of excitement around the Atlas API that's exposed under the covers of the new Azure Purview governance offering. There are a couple of different libraries available currently, so don't be surprised if we see a lot of shifts & changes as the preview matures!

In this video, Simon takes a look at how you can get started with the API in a Databricks Notebook to register a custom lineage between two entities

For more info on the pyapacheatlas library used, see: https://pypi.org/project/pyapacheatlas/

As always, don't forget to Like & Subscribe, and let us know what you think!

Комментарии

Информация по комментариям в разработке

Похожие видео