Azure Data Factory : from Zero to Hero of Azure Data Factory

Focused View

Supria Santra

10:50:05

20 View

1. Introduction

1.1 MS ADF Masterclass Zero To Hero - Course Structure.xlsx

1. Intro + Course Structure + Objectives.mp4

05:56

2.1 ADF Course Data.zip

2.2 ADF Course PPT.pptx

2. What is Cloud Computing.mp4

03:00

3. What is ADF (with example).mp4

06:08

2. Environment Setup

1. Create Azure Account.mp4

02:51

2. Azure Portal Walkthrough.mp4

07:40

3. Create storage account.mp4

09:15

4. Create Azure DataLake Gen2 account.mp4

04:41

5.1 SQL data creation query.txt

5. Create SQL DB.mp4

12:22

6. Create ADF.mp4

04:33

7. Create SQL Server VM.mp4

12:47

3. Building Blocks of ADF

1. ADF Building Blocks Overview.mp4

00:32

2. Pipelines.mp4

04:47

3. Activities.mp4

05:44

4. Linked Services.mp4

06:33

5. DataSets.mp4

08:07

6. Supported File Formats.mp4

08:17

7. Triggers.mp4

06:19

8. Interaction between different components.mp4

02:13

4. Copy Data Activity

1.1 ADF Course Data.zip

1. Copy Data from Blob to ADLS.mp4

28:16

2. Copy Data - Logging settings.mp4

06:39

3. Copy Data - Multiple files from a folder & other settings.mp4

17:18

4. Copy Data - Last modified filter.mp4

07:18

5.1 SQL data creation query.txt

5. RWS #3 Append Filename Column during copy.mp4

05:48

6. Copy data for Azure SQL Tables.mp4

12:56

7.1 SQL data creation query.txt

7. Copy Data - Fault tolerance.mp4

09:50

8. Setting up self hosted IR.mp4

05:16

9. Copy data for On prem DB.mp4

08:27

10. Copy Data from REST API.mp4

08:51

5. Parameters & Variables

1.1 ADF Course Data.zip

1. Parameterized componenets.mp4

14:13

2. Variables in ADF.mp4

02:29

3. System Variables.mp4

06:23

4. Set Variable Activity.mp4

04:13

6. Control Flow Activities

1.1 ADF Course Data.zip

1. Filter.mp4

03:33

2. For each.mp4

07:30

3. Lookup.mp4

10:00

4.1 SQL data creation query.txt

4. RWS #2 Copy Multiple Files in bulk using lookup table - Usecase & Hints.mp4

02:01

5. Get metadata.mp4

07:51

6. RWS #1 Copy files that are modified in last one day - Usecase & Hints.mp4

02:13

7. if condition.mp4

06:42

8. Wait.mp4

02:46

9. Switch.mp4

05:10

10. Validation.mp4

07:31

7. Other Important Pipeline activities

1.1 ADF Course Data.zip

1.2 SQL data creation query.txt

1. Stored Procedure.mp4

05:13

2.1 SQL data creation query.txt

2. RWS #5 Save pipeline run details in SQL table for audit - Usecase & Hints.mp4

05:51

3. Delete Activity.mp4

04:30

4. Fail Activity.mp4

03:41

5. Execute pipeline.mp4

03:30

6. Dataflow Activity.mp4

04:14

8. Mapping DataFlows

1.1 ADF Course Data.zip

1. Mapping Data Flows Introduction.mp4

03:39

2. Source + validate schema + schema Drift.mp4

14:53

3. Sink + Error row handling.mp4

15:31

4. Select.mp4

02:48

5. Filter.mp4

05:28

6. Conditional split.mp4

04:24

7. Union.mp4

01:45

8. Exist.mp4

05:01

9. Sort.mp4

03:51

10. Rank transformation.mp4

04:19

11. Aggregte.mp4

03:47

12. Join.mp4

04:47

13. Pivot.mp4

07:54

14. Lookup.mp4

05:13

15. Derived column.mp4

07:02

16. New branch.mp4

02:23

17. Surrogate key.mp4

03:26

18. Flatten.mp4

08:11

19.1 SQL data creation query.txt

19. Alter row.mp4

14:48

20. Assert.mp4

15:54

9. Advanced Concepts

1.1 ADF Course Data.zip

1.2 SQL data creation query.txt

1. Expression Language.mp4

13:18

2. Dynamic queries.mp4

17:03

10. Triggers

1. What is trigger.mp4

02:22

2. Types of ADF triggers.mp4

01:50

3. Schedule Triggers.mp4

12:22

4. Event based Triggers.mp4

08:38

5. Tumbling window triggers.mp4

17:15

11. Monitoring

1. Monitoring Capabilities.mp4

08:59

12. Real World Use Cases

1.1 ADF Course Data.zip

1. Fact & Dimension tables.mp4

04:00

2. Slowly Changing Dimensions (SCD) types.mp4

07:53

3. SCD Type 1 Implementation.mp4

04:03

4.1 SQL data creation query.txt

4. SCD Type 2 Implementation.mp4

24:04

5.1 SQL data creation query.txt

5. Implementation of Incremental Data Load - Usecase & Hints.mp4

04:22

13. Real World Scenarios (RWS) - for Interviews

1.1 ADF Course Data.zip

1. RWS #1 - Copy files which are modified within last one day.mp4

07:59

2. RWS #2 - Bulk Copy.mp4

13:15

3.1 SQL data creation query.txt

3. RWS #3 - Appending Source Filename Dynamically During Copy.mp4

05:48

4.1 SQL data creation query.txt

4. RWS #4 - Incremental Loading.mp4

24:01

5.1 SQL data creation query.txt

5. RWS #5 - Loading Pipeline run details in SQL Table for audit.mp4

05:51

Description

Comprehensive Azure Data Factory Practical Hands-on tutorial REST API, SQL DB,VM, DataLake [DP-203]& Interview Questions

What You'll Learn?

100% In depth Hands on Practical Lab Sessions
Real World Scenario based Interview Questions
Real World Use Cases will detailed solutions
Create Data driven, fully integrated, dynamic and automated production grade pipeline creation and orchestration
Data Warehousing Concepts like Fact & dimension tables, SCD type1, type2, Incremental loading and implement using ADF
All the topics related to Azure Data Factory in DP 203, DP 900 certification are covered in this course.
Connect & copy data from On Premise data stores, On premise SQL server via Self Hosted Integration Runtime to cloud
Gain good Data Engineering skills in Azure using Azure Data Factory (ADF), Azure Data Lake Gen2, Azure SQL Database, Azure Blob Storage and REST API
How to ingest data from sources such as REST API, Azure Blob Storage, SQL DB into Azure Data Lake Gen2 using Azure Data Factory (ADF)
How to transform data using Data Flows in Azure Data Factory (ADF) and load into Azure Data Lake Storage Gen2
Learn extensively about Triggers in Azure Data Factory (ADF) and how to use them to schedule the data pipelines.
How to build production ready pipelines and good practices and naming standards

Who is this for?

College / University Students looking for a career in Data Engineering

Freshers interested in Data Engineering on Microsoft Azure

Mid Level Data Engineering, Data Integration, ETL Developers

Data Engineers/ Data Warehouse Developers currently working on on-premises technologies, or other cloud platforms such as AWS or GCP who want to learn Azure Technologies

Professionals willing to do Microsoft Certifications such as DP-900, DP-203 etc

Mid Level Professionals who wants to learn Azure & Data Engineering

Experienced Professionals willing to master Azure Data Factory

Experienced Professionals willing to be Architect in order to understand capability of Data Factory

Data Scientists who want extend their knowledge into data engineering

What You Need to Know?

None

More details

Description
Welcome to this amazing Azure Data Factory course. Below are key highlights of this course -

Fully Lab based Hands-on Course.
Course covers from basics to advanced concepts of Azure DataFactory.
Real World Scenario based Azure Data Factory Interview Questions with detailed solution.
Real World Data Warehousing concepts like SCD type 1 & 2, Incremental load and complete Implementation using ADF.
Automated, Data-Driven, Dynamic Production grade Pipeline creation and Orchestration using ADF.
Covers most frequently used data sources such as Azure Blob, Azure Data Lake Gen2, Azure SQL DB, REST API, On Premise Database, On Premise Virtual Machines etc.
Covers Parameterized components and dynamic queries to build dynamic and flexible robust pipelines.
Covers all the important configurations and settings of different activities with practical demo.
Covers different types of Triggers, scheduling and their application in details. Trigger dependencies and pipeline chaining also covered.
Mapping Data Flows to create data transformation logics.
Debugging data flows, investigating issues, fixing failures etc .
Creating dependency between pipelines to orchestrate the data flow.
Building a solution architecture for a data engineering solution using Azure Data Engineering technologies such as Spark based Azure Data Factory (ADF), Azure Data Lake Gen2, Azure Blob Storage, Azure SQL Database, On Premise Database, On Premise Virtual Machines and RESTful API.
If you are planning for Microsoft Azure Data Engineer certification [DP-900], [DP-203] then this course covers all concepts related to Azure DataFactory.

Who this course is for:
College / University Students looking for a career in Data Engineering
Freshers interested in Data Engineering on Microsoft Azure
Mid Level Data Engineering, Data Integration, ETL Developers
Data Engineers/ Data Warehouse Developers currently working on on-premises technologies, or other cloud platforms such as AWS or GCP who want to learn Azure Technologies
Professionals willing to do Microsoft Certifications such as DP-900, DP-203 etc
Mid Level Professionals who wants to learn Azure & Data Engineering
Experienced Professionals willing to master Azure Data Factory
Experienced Professionals willing to be Architect in order to understand capability of Data Factory
Data Scientists who want extend their knowledge into data engineering

User Reviews

Rating

average 0

Total votes0

Focused display

- Microsoft Certified Azure Data Engineer with expertise in Data Engineering /Data warehouse domain in designing an implementing solutions for ETL, reporting, analytics on Cloud such as MS Azure.- Seasoned Data Engineering / Data warehouse professional having experience of 8+ years.- International work experience at locations such as USA, Japan , India in Banking, Insurance & Shipping domain.

Udemy

View courses Udemy

Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.