Create and Monitor Data Pipelines for a Stream Processing Solution

Focused View

Ana Voicu

1:06:28

124 View

1. Course Overview

1. Course Overview.mp4

02:08

02. Creating a Stream Processing Solution with Azure Technology

01. Introduction.mp4

02:00

02. Designing a Stream Processing Solution.mp4

03:51

03. Choosing a Real-time Message Ingestion Tool.mp4

05:32

04. Choosing a Stream Processing Solution.mp4

02:50

05. Choosing the Analytical Components.mp4

05:13

06. Exercises with Azure Components.mp4

07:17

07. Working with Functions That Produce Non-overlapping Time Win.mp4

05:34

08. Working with Functions That Produce Overlapping Time Windows.mp4

04:34

09. Exercises with Window Functions.mp4

04:35

10. Summary.mp4

01:19

3. Optimizing Your Stream Analytics Job

1. Introduction.mp4

01:02

2. Monitoring Your Job.mp4

03:48

3. Understanding and Adjusting Streaming Units.mp4

02:26

4. Improving the Performance of Your Job with Parallelization.mp4

05:31

5. Calculating the Maximum Streaming Units for a Job.mp4

02:19

6. Test Your Knowledge on Ways to Optimize Your Azure Stream Analytics Job.mp4

04:33

7. Summary.mp4

01:56

Description

This course will teach you how to create, configure, monitor, and troubleshoot Azure Stream Analytics jobs to process live streaming data.

What You'll Learn?

Azure gives you all of the resources you need to create and monitor data pipelines and find the data processing solutions you need. In this course, Create and Monitor Data Pipelines for a Stream Processing Solution, you'll learn how to work with stream processing pipelines in Azure in order to create, configure, monitor, and troubleshoot Azure Stream Analytics jobs. First, you'll discover the components of a stream analytics job and why each of them are important. Next, you'll explore how to handle the data coming from the pipeline (insert and update), how to visualize the data in different time windows, and how to troubleshoot such a job. Finally, you'll learn how to improve the performance of your job, by choosing the number of streaming units, parallelizing the query, and using repartitioning to scale your query. By the end of this course, you'll have a better understanding of what it means to create and monitor real-time data processing solutions in Azure.

More details

User Reviews

Rating

average 0

Total votes0

Focused display

Software Engineering

Software Architecture

Software Development

Ana Voicu

Instructor's Courses

Ana Voicu is a software developer passionate about databases, Business Intelligence, and data science. She works on developing enterprise level Business Intelligence solutions for various types of industries, with a focus on performance optimization, pattern recognition, efficient analysis of the business processes, and interactive visualizations. What Ana loves most is overcoming challenges related to database performance, mostly related to data warehouse solutions. Ana discovered a while ago that she loves sharing with others all of what she knows and learns. You can find her two cents on Twitter (@sqlbythebook) or on her blog, www.sqlbythebook.com

Pluralsight

View courses Pluralsight

Pluralsight, LLC is an American privately held online education company that offers a variety of video training courses for software developers, IT administrators, and creative professionals through its website. Founded in 2004 by Aaron Skonnard, Keith Brown, Fritz Onion, and Bill Williams, the company has its headquarters in Farmington, Utah. As of July 2018, it uses more than 1,400 subject-matter experts as authors, and offers more than 7,000 courses in its catalog. Since first moving its courses online in 2007, the company has expanded, developing a full enterprise platform, and adding skills assessment modules.