Rename Files in Data Lake Using Azure Databricks

Описание к видео Rename Files in Data Lake Using Azure Databricks

Created By: Muditha Pelpola
LinkedIn:   / muditha-pelpola  
#Azure #AzureDatalake #Databricks #python #dataengineering

This is my 8th YouTube video for Data Community and this time I selected a topic related to data Engineering with Azure Data bricks . Main reason was , I faced some challenges to rename some set of files in Azure Data Lake (Gen 2) and manually doing it was a time consuming and there I used “Microsoft Azure File Data Lake Storage Client Library” and used DataLakeServiceClient & FileSystemClient to access Azure Data Lake (Gen 2).There I selected Azure Data bricks as a tool with good compute power to process large files in less time.

Комментарии

Информация по комментариям в разработке