End to End Azure Data Engineering Real Time Project- 3 Hours

Focused View

Mr. K Talks Tech

2:47:18

9 View

1. Introduction.mp4

11:02

2. Environment Setup.mp4

08:38

3. Data Ingestion (Part-1).mp4

21:56

4. Data Ingestion (Part-2).mp4

20:04

5. Data Transformation (Part-1).mp4

14:40

6. Data Transformation (Part-2).mp4

20:04

7. Data Transformation (Part-3).mp4

15:01

8. Data Loading using Azure Synapse Analytics.mp4

23:28

9. Data Reporting using Power BI.mp4

14:40

10. Security and Governance.mp4

07:07

11. End to End Pipeline Testing.mp4

10:38

Description

Azure Data Engineer Project using the modern Data Tools like ADF, Azure Databricks, Azure Synapse Analytics, ADLS Gen2

What You'll Learn?

Build real time Azure Data Engineering Project
Data Integration
Build Pipelines
Big Data Transformation
Reporting using Power BI

Who is this for?

This course is for absolute beginners who is looking to become an Azure Data Engineer

What You Need to Know?

Basic Programming skills

More details

Description
This is a long awaited video of mine- Lets build a complete End to End Azure Data Engineering Project. In this project we are going to create an end to end data platform right from Data Ingestion, Data Transformation, Data Loading and Reporting.

The tools that are covered in this project are,

Azure Data Factory
Azure Data Lake Storage Gen2
Azure Databricks
Azure Synapse Analytics
Azure Key vault
Azure Active Directory (AAD) and
Microsoft Power BI

The use case for this project is building an end to end solution by ingesting the tables from on-premise SQL Server database using Azure Data Factory and then store the data in Azure Data Lake. Then Azure databricks is used to transform the RAW data to the most cleanest form of data and then we are using Azure Synapse Analytics to load the clean data and finally using Microsoft Power BI to integrate with Azure synapse analytics to build an interactive dashboard. Also, we are using Azure Active Directory (AAD) and Azure Key Vault for the monitoring and governance purpose. In this video, I have also covered the complete end to end pipeline testing right from how a new data gets ingested followed by the data transformation until it goes updating the report that we will be creating using the Power BI
Who this course is for:
This course is for absolute beginners who is looking to become an Azure Data Engineer

User Reviews

Rating

average 0

Total votes0

Focused display

Mr. K is a passionate teacher created this channel for only one goal "TO HELP PEOPLE LEARN THE MODERN DATA PLATFORM SOLUTIONS USING CLOUD TECHNOLOGIES" I will be creating playlist which covers the below topics (with DEMO) 1. Azure Beginner Tutorials 2. Azure Data Factory 3. Azure Synapse Analytics 4. Azure Databricks 5. Microsoft Power BI 6. Azure Data Lake Gen2 7. Azure DevOps 8. GitHub (and several other topics) Can't wait to help people with my videos. Stay tuned!

Udemy

View courses Udemy

Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.