Data Engineer Mock Interview | ADF | Medallion Architecture | BRONZE, SILVER & GOLD Layer| ADLS GEN2

To enhance your career as a Cloud Data Engineer, Check https://trendytech.in/?src=youtube&su... for curated courses developed by me.

I have trained over 20,000+ professionals in the field of Data Engineering in the last 5 years.

30 INTERVIEWS IN 30 DAYS- BIG DATA INTERVIEW SERIES

This mock interview series is launched as a community initiative under Data Engineers Club aimed at aiding the community's growth and development

Our highly experienced guest interviewer, Ankur Bhattacharya,   / ankur-bhattacharya-10055877   shares invaluable insights and practical advice coming from his extensive experience, catering to aspiring data engineers and seasoned professionals alike.

Our talented guest interviewee, Sasiram Kolisetty   / kolisetty-sasiram-02852b186   has a remarkable approach to answering the interview questions in a very well articulated manner. Where he talks about the complete Medallion Architecture followed in the projects that he worked on belonging to Insurance and Green Energy Domain. He describes how the raw data was initially added to the bronze layer tables. Then performed cleaning and transformations on this data which was then added to the Silver layer tables. Finally, based on the business requirements, data was aggregated and the results were added to the Gold Layer.

Link of Free SQL & Python series developed by me are given below -
SQL Playlist -    • SQL tutorial for everyone by Sumit Si...  
Python Playlist -    • Complete Python By Sumit Mittal Sir  

Don't miss out - Subscribe to the channel for more such informative interviews and unlock the secrets to success in this thriving field!

Social Media Links :
LinkedIn -   / bigdatabysumit  
Twitter -   / bigdatasumit  
Instagram -   / bigdatabysumit  
Student Testimonials - https://trendytech.in/#testimonials

Discussed Questions with Timestamp
3:51 Brief discussion about the project.
9:06 What business problem are you solving in your project?
9:56 What work have you done to secure your data?
11:20 Do you use Unity Catalog for role-based policy?
11:33 How do you resolve bottlenecks in terms of latency in your pipeline?
15:14 If you have 2 large tables, what kind of join strategy will you follow?
16:12 Difference between bucketing and Z-ordering.
16:48 How do you perform data ingestion?
18:20 How would you create a pipeline for real-time data updates, aggregation, and live dashboard creation?
20:13 What triggers are available in ADF?
21:18 How does lazy evaluation help in Spark optimization?
22:45 What approach would you take for cluster configuration
24:53 SQL coding question

Tags
#mockinterview #bigdata #career #dataengineering #data #datascience #dataanalysis #productbasedcompanies #interviewquestions #apachespark #google #interview #faang #companies #amazon #walmart #flipkart #microsoft #azure #databricks #jobs