Deploying Data Pipelines in Microsoft Azure

Focused View

Marcelo Pastorino

1:28:22

8 View

01 - Course Overview

01 - Course Overview.mp4

01:59

02 - Getting Started Deploying Data Pipelines in Azure

02 - Introduction.mp4

00:57

03 - Learning the Advantages of Integrating GIT with Azure Data Factory.mp4

03:06

04 - Learning Two Different Ways to Tackle the Problem.mp4

01:21

05 - Summary.mp4

00:54

03 - Creating the Data Pipeline Deployment Infrastructure

06 - Introduction.mp4

01:59

07 - Creating Azure Resource Groups.mp4

01:52

08 - Creating Azure Storage Accounts.mp4

03:27

09 - Creating Azure Key Vaults.mp4

01:13

10 - Summary.mp4

00:44

04 - Creating Azure Data Factory Environments

11 - Introduction.mp4

00:26

12 - Creating Azure Data Factories.mp4

01:53

13 - Configuring Azure Data Factory to Use Azure KeyVault.mp4

04:44

14 - Creating an Azure Data Factory Pipeline.mp4

06:18

15 - Summary.mp4

00:23

05 - Integrating Azure Data Factory Pipelines with Source Control Using Azure DevOps

16 - Introduction.mp4

00:37

17 - Introducing Azure DevOps and Configuring Azure Repos.mp4

02:14

18 - Integrating Azure Data Factory with Azure DevOps.mp4

04:31

19 - Summary.mp4

00:50

06 - Deploying Data Pipelines Using ARM Templates and Azure DevOps

20 - Introduction.mp4

00:34

21 - Understanding Azure Data Factory Continuous Ingratiation Life Cycle.mp4

02:31

22 - Creating a Feature Branch and Making Changes to the Pipeline.mp4

04:14

23 - Creating a Pull Request and Publishing Changes.mp4

03:44

24 - Exporting ARM Templates from the Collaboration Pipeline.mp4

01:45

25 - Deploying to the Staging Environment.mp4

04:03

26 - Deploying to the Production Environment.mp4

02:22

27 - Summary.mp4

01:04

07 - Implementing Continuous Integration and Delivery of Azure Data Factory Pipelines Using Azure DevOps

28 - Introduction.mp4

00:33

29 - Getting Started with Azure Data Factory and CI CD Using Azure DevOps.mp4

01:25

30 - Creating Variable Groups in Azure DevOps.mp4

01:12

31 - Creating a Release Pipeline in Azure DevOps.mp4

02:42

32 - Selecting an Artifact.mp4

01:13

33 - Adding Tasks to the Pipeline Stage.mp4

04:37

34 - Adding Pre and Post Deployment PowerShell Scripts.mp4

04:34

35 - Cloning Stages, Linking Variable Groups, and Configuring Permissions.mp4

03:39

36 - Enabling Continuous Deployment Trigger and Pre-deployment Conditions.mp4

01:14

37 - Implementing a New Feature in the Development Environment.mp4

02:32

38 - Deploying to the Staging Environment.mp4

02:15

39 - Deploying to the Production Environment.mp4

02:13

40 - Summary.mp4

00:28

Description

In this course, you will learn foundational knowledge needed to apply CI/CD methodologies to your pipeline creation process in Azure Data Factory to deploy robust and well-tested data pipelines to production.

What You'll Learn?

Data engineers working with Azure Data Factory can take advantage of Continuous Integration and Continuous Delivery practices to deploy robust and well-tested data pipelines to production.

In this course, Deploying Data Pipelines in Microsoft Azure, you will learn foundational knowledge to apply CI/CD methodologies to your data pipeline creation process.

First, you will learn to create the right environments to fall into the pit of success when creating data pipelines in ADF.

Next, you will discover how to deploy data pipelines using ADF visual tools and ARM templates.

Finally, you will explore how to create a release pipeline in Azure DevOps to automate the deployment process between three distinct environments: development, staging, and production.

When you are finished with this course, you will have the skills and knowledge to apply CI/CD practices to your data pipeline creation process, effortlessly.

More details

User Reviews

Rating

average 0

Total votes0

Focused display

Data Science

Microsoft Azure

Marcelo Pastorino

Instructor's Courses

Marcelo has over 20 years of professional experience solving business problems and creating new opportunities for companies by architecting solutions and developing software for the web, cloud, and mobile devices. He started coding for fun in the early 90s in an old IBM 8086 XT, in now-defunct programming languages like Clipper, Pascal, and dBase III and sold his first piece of software for the DOS operating system at age 16. These days, his preferred stacks are Microsoft's .NET, C#, Xamarin, Azure and JavaScript, TypeScript, React, React Native, Next.js, and everything around these fantastic technologies. Marcelo is a passionate and pragmatic developer, an avid learner, and a fan of clean code and best practices. He has worked for companies in various software development roles with pride in building quality software. In his spare time, he is creating SoftwareDeveloper.io, an app to enable Software Developers and other tech roles to find their perfect remote job opportunities and help them stand out as professionals.

Pluralsight

View courses Pluralsight

Pluralsight, LLC is an American privately held online education company that offers a variety of video training courses for software developers, IT administrators, and creative professionals through its website. Founded in 2004 by Aaron Skonnard, Keith Brown, Fritz Onion, and Bill Williams, the company has its headquarters in Farmington, Utah. As of July 2018, it uses more than 1,400 subject-matter experts as authors, and offers more than 7,000 courses in its catalog. Since first moving its courses online in 2007, the company has expanded, developing a full enterprise platform, and adding skills assessment modules.