Simplifying Complex Data Structures with DataForge: Subsources Feature Demo

In this video, Vadim Orlov, CTO and Founder of DataForge, walks you through the latest DataForge feature – Subsources.

This feature simplifies working with complex data structures such as nested JSON arrays without the need for normalization. Join Vadim as he demonstrates how to streamline data transformations and generate outputs using DataForge, enhancing your data engineering workflows.

Try out DataForge today with a 30-day free trial and stay ahead in automating data pipelines.

📄 Blog: https://dataforgelabs.com/blog/sub-so...
🌐 Website: https://www.dataforgelabs.com
🎥 Free Trial: https://accounts.cloud.dataforgelabs....

Chapters:
00:00 - Introduction: Vadim Morlov & DataForge Subsources
00:25 - Dataset Structure Overview (Orders in an Online Store)
02:19 - ERD Structure and Normalization Approach
03:28 - Ingesting Data into DataForge
04:54 - Exploring the Data and Creating Transformations
06:13 - Introducing Sub-Sources
06:56 - Creating Rules and Performing Calculations
08:54 - Materializing Calculated Data in Databricks
10:18 - Visualizing Data Lineage
12:45 - Pulling Nested Tags Data
16:52 - Aggregating Data with Calculations
18:49 - Creating Outputs from Sub-Sources
20:42 - Flattened Dataset Review
22:25 - Conclusion & Next Steps

If you found this video helpful, please like and subscribe for more updates, and don’t hesitate to leave your comments and feedback below!