Incremental Data Loading from an ERP System into Azure Data Lake Using Azure Data Factory

Описание к видео Incremental Data Loading from an ERP System into Azure Data Lake Using Azure Data Factory

Created By: Muditha Pelpola
LinkedIn:   / muditha-pelpola  

This is my 5th YouTube video and this time I decided to talk about Data Engineering related topic .

In this video session I talked about how to push incremental data into Azure Data Lake using Azure Data Factory.
Here I selected an ERP system (Infor m3) that I worked with more than 5 years. I got business problem to push M3 ERP tables into data lake
with a file structure “ M3 File Name Year  Month  Date ( Based on M3 Last modified record) “. Without hardcoding values in Data Factory
to create file structure automatically based on M3 Last modified date was the challenge .
I solved it using Data Factory expression and this video is to share my experience with data community.

Комментарии

Информация по комментариям в разработке

Похожие видео