Welcome to an exciting session where we'll build a real-time streaming Data Engineering project using Azure services! This is one of the best ways to get hands-on experience with real-time streaming while understanding architectural decision-making for cost and performance optimization.
In this project, we’ll:
Set up a real-time weather report system using Weather API
Implement data ingestion using Azure Databricks and Azure Functions
Use Event Hub for streaming and Microsoft Fabric for real-time intelligence
Load data into Kusto DB and create an interactive Power BI dashboard
Set up real-time alerts for extreme weather using Data Activator
This project covers everything from data source setup to reporting and alerting, providing hands-on skills in modern data engineering! 💻
📅 Agenda:
Environment Setup
Data Ingestion
Cost Analysis & Architectural Decisions
Real-Time Streaming & Processing
Power BI Dashboard & Real-Time Alerts
Please like, share and subscribe if you like the content and leave your comments below.
For contact,
Email: mrktalkstech@gmail.com
Instagram: mrk_talkstech_tamil
コメント