Create and Monitor Data Pipelines for a Batch Processing Solution

Focused View

Bismark Adomako

1:29:36

120 View

1. Course Overview

1. Course Overview.mp4

01:36

2. Working with Data Storage

1. Overview.mp4

01:18

2. Batch Mode Architecture.mp4

04:28

3. Choose a Data Storage Approach in Azure.mp4

06:25

4. Provision and Configure Resources.mp4

03:36

5. Summary.mp4

00:22

03. Creating and Orchestrating Data Movement

01. Overview.mp4

00:54

02. Reviewing the Globomantics Scenario.mp4

02:57

03. Preparing Data for Upload.mp4

02:34

04. Configuring the Data Source.mp4

05:51

05. Configuring the Data Destination.mp4

06:28

06. Accessing Data Lake Storage - Configuring Key Vault.mp4

07:28

07. Accessing Data Lake Storage - Creating the Dimension Tables.mp4

08:35

08. Orchestrating Data Processing with Synapse Pipelines - Linked Services and.mp4

10:19

09. Orchestrating Data Processing with Synapse Pipelines.mp4

10:57

10. Summary.mp4

00:40

4. Design and Implement the Serving Layer

1. Overview.mp4

00:54

2. Design and Implement the Report Views.mp4

01:40

3. Securing the Serving Layer.mp4

03:05

4. Designing the Power BI Report.mp4

03:46

5. Summary.mp4

00:14

5. Monitoring Data Storage and Processing

1. Overview.mp4

00:41

2. Azure Monitor Overview.mp4

01:20

3. Creating a Diagnostic Setting.mp4

01:47

4. Analyzing Metrics and Logs.mp4

01:27

5. Summary.mp4

00:14

Description

Data analytics at the serving layer come easy with a well designed and implemented data process. This course will teach you key considerations and design principles of creating and monitoring data pipelines for a batch processing solution.

What You'll Learn?

As a data specialist, you may be required to design and implement an end-to-end data pipeline for a batch processing solution. In this course, Create and Monitor Data Pipelines for a Batch Processing Solution, you’ll learn to design and implement data pipelines for a batch processing solution. First, you’ll explore the available data storages on Azure. Next, you’ll discover and develop batch processing solutions using Azure Data Factory and the available data storages. Finally, you’ll learn how to automate the data processing process and how to monitor for optimization and efficiency. When you’re finished with this course, you’ll have the skills and knowledge of a data professional needed to build and monitor end-to-end data pipelines.

More details

User Reviews

Rating

average 0

Total votes0

Focused display

Software Engineering

Software Architecture

Software Development

Bismark Adomako

Instructor's Courses

Bismark believes that education is no longer a one-time investment, but instead a lifelong pursuit and that great authors and mentors can play an invaluable role in finding and developing a fulfilling career. He holds a Bachelor of Science degree in Computer Engineering specializing in Software Engineering, Artificial Intelligence and Distributed computing. He taught courses in robotics and computer vision as a student leader whiles in school, and interned and consulted for the British Council as a Software Engineer and Project Assistant. He currently works as a Business Intelligence and Big Data developer doubling up as a Data Scientist at Ecobank eProcess International S.A. developing machine learning models some of which includes the Customer360 model consisting of a customer segmentation model, customer churn model, and customer cross selling (product recommendation) model. He has enterprise level knowledge in data integration for BI & Data Management domain applications.

Pluralsight

View courses Pluralsight

Pluralsight, LLC is an American privately held online education company that offers a variety of video training courses for software developers, IT administrators, and creative professionals through its website. Founded in 2004 by Aaron Skonnard, Keith Brown, Fritz Onion, and Bill Williams, the company has its headquarters in Farmington, Utah. As of July 2018, it uses more than 1,400 subject-matter experts as authors, and offers more than 7,000 courses in its catalog. Since first moving its courses online in 2007, the company has expanded, developing a full enterprise platform, and adding skills assessment modules.