Part 2- End to End Realtime Streaming Azure Data Engineering Project (Environment Setup)

Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the entire environment setup process, covering all the essential resources we’ll use to build a real-time weather reporting system using Azure services and Microsoft Fabric.

TimeStamp:

0:00:00 - Setting up the Weather API
0:03:58 - Creating Resource Group
0:07:09 - Creating Azure Databricks
0:12:59 - Creating Azure Function APP
0:20:16 - Creating Azure Event HUB
0:25:24 - Creating Azure Key Vault, RBAC and Creating Secrets
0:36:08 - Creating Microsoft Fabric

#DataEngineering #AzureDatabricks #AzureFunctions #EventHub #MicrosoftFabric #RealTimeData #StreamingData #PowerBI #KustoDB #DataActivator #CloudData #WeatherData #EndToEndProject #DataIngestion #DataPipeline #AzureEventHub #RealTimeAlerts


– – – Book a Private One on One Meeting with me (1 Hour) – – –

https://www.buymeacoffee.com/mrktalks...

– – – Express your encouragement by brewing up a cup of support for me – – –

https://www.buymeacoffee.com/mrktalks...


– – – Other useful playlist: – – –

1. Microsoft Fabric Playlist:    • Microsoft Fabric Tutorials  
2. Azure General Topics Playlist:    • Azure Beginner Tutorials  
3. Azure Data Factory Playlist:    • Azure Data Factory Tutorials  
4. Databricks CICD Playlist:    • CI/CD (Continuous Integration and Con...  
5. Azure Databricks Playlist:    • Azure Databricks Tutorials for Beginners  
6. Azure End to End Project Playlist:    • End to End Azure Data Engineering Rea...  
7. End to End Azure Data Engineering Project:    • An End to End Azure Data Engineering ...  

– – – Let’s Connect: – – –

Email: [email protected]
Instagram: mrk_talkstech

– – – About me: – – –

Mr. K is a passionate teacher created this channel for only one goal "TO HELP PEOPLE LEARN ABOUT THE MODERN DATA PLATFORM SOLUTIONS USING CLOUD TECHNOLOGIES"

I will be creating playlist which covers the below topics (with DEMO)

1. Azure Beginner Tutorials
2. Azure Data Factory
3. Azure Synapse Analytics
4. Azure Databricks
5. Microsoft Power BI
6. Azure Data Lake Gen2
7. Azure DevOps
8. GitHub (and several other topics)

After creating some basic foundational videos, I will be creating some of the videos with the real time scenarios / use case specific to the three common Data Fields,

1. Data Engineer
2. Data Analyst
3. Data Scientist

Can't wait to help people with my videos.

– – – Support me: – – –

Please Subscribe:    / @mr.ktalkstech