Data Engineering on Microsoft Azure: The Definitive Guide

Focused View

Wadson Guimatsa

11:54:30

49 View

01 - Introduction - Understanding Core Data Concepts

001 Introduction.mp4

02:26

002 What is Data - A simple definition.mp4

05:16

003 What is Structured Data.mp4

03:47

004 What is Non Relational Data.mp4

02:52

005 What is Data Ingestion.mp4

04:00

006 What is Data Processing.mp4

06:40

007 Batch Processing vs Stream Processing.mp4

03:00

008 What is Data Analytics.mp4

08:33

02 - Azure SQL - Introduction

001 Create a Single Instance Database.mp4

08:30

002 What is a Resource Group.mp4

04:01

002 weblinks.pdf

003 Azure Data Studio - Introduction.mp4

08:30

003 weblinks.pdf

004 Create a Virtual Machine.mp4

07:03

005 Connect to Azure Database from an Azure Virtual Machine.mp4

10:07

005 mssql-cli-guide.txt

006 Authentication and Authorization.mp4

11:02

007 Create a SQL Login and User.mp4

10:03

007 azsql-createuser.zip

008 SQL Server Management Studion - Introduction.mp4

05:07

008 weblinks.pdf

009 Understanding Tables and Views.mp4

07:45

010 How to Create a Database Diagram in SSMS.mp4

04:15

011 Azure Cost Management - How to Create a Budget in Azure.mp4

11:21

03 - Azure Blob Storage - Introduction

001 Introduction to Azure Storage.mp4

02:57

002 Create an Azure Storage Account.mp4

07:38

003 AzureStorage-WebResources.pdf

003 Upload Data using the Azure Portal.mp4

08:37

003 blobs.zip

004 Upload Data using Azure Storage Explorer.mp4

11:15

004 blobs.zip

005 AzureStorage-WebResources.pdf

005 Connect a Storage Account with a Shared Access Signature.mp4

12:11

006 AzureStorage-WebResources.pdf

006 Azure CLI - Generate a Shared Access Signature.mp4

13:09

006 generate-sas-cli.txt

007 AzureStorage-WebResources.pdf

007 Understanding Data Redundancy.mp4

05:47

008 AzureStorage-WebResources.pdf

008 Azure Storage Account - Redundancy Options.mp4

10:09

04 - Azure Data Factory - Core Concepts

001 Section Intro.mp4

02:23

002 Create Data Store and Target.mp4

12:00

002 wideworldimporters-standard.zip

003 Create Data Factory and Linked Services.mp4

13:04

003 Section-ADF-Important-Links.pdf

004 Create Datasets.mp4

06:33

005 Create Pipeline and Activities.mp4

08:33

006 Create Mapping Data Flow and Adding Sources.mp4

07:17

007 Mapping Data Flow - Joining Sources.mp4

03:18

008 Mapping Data Flow - Aggregate Data.mp4

05:55

009 Mapping Data Flow Execution.mp4

04:10

010 Mapping Data Flow and Apache Spark Execution.mp4

06:58

05 - Practice Section Build an ETL Pipeline with Azure Data Factory

001 Introduction.mp4

02:34

002 Cost Warning - Data Pipeline Pricing.mp4

03:35

003 BuildingEnd2EndPipelineResources.zip

003 IMPORTANT Download Resources Before Starting.html

004 Azure SQL - Contained Users.mp4

09:45

005 Azure Key Vault - Store SQL Server Secrets.mp4

08:28

006 Azure Key Vault - Linked Service.mp4

07:34

007 Create Azure Storage Account.mp4

02:47

008 Azure Managed Identity - Create a Linked Service To Azure Blob Storage.mp4

10:45

009 Azure Role Based Access Control - Grant Access To Managed Identity.mp4

11:48

010 Create a Dataset for the Lookup Activity.mp4

03:41

011 Azure Data Factory - Lookup Activity.mp4

05:43

012 Azure Data Factory - ForEach Activity And Pipeline Expressions.mp4

09:08

013 Azure Data Factory - ForEach Activity - Part II.mp4

07:40

014 Parameterize a Dataset Part I - Container Name.mp4

09:01

015 Parameterize a Dataset Part II - Directory Name.mp4

03:41

016 Parameterize a Dataset Part III - File Name.mp4

07:54

017 Mapping Data Flow - JSON Source.mp4

08:44

018 Mapping Data Flow - Parquet Source.mp4

06:53

019 Mapping Data Flow - JOIN And Derived Column Transformations.mp4

09:35

020 Mapping Data Flow - Aggregate Transformation.mp4

04:53

021 Mappind Data Flow - Parameterized CSV File Sink.mp4

08:11

022 Azure Data Factory - Store SAS In Azure Key Vault.mp4

06:36

023 Azure Data Factory - Copy Activity Merge Behaviour.mp4

07:33

024 Azure Data Factory - End To End Pipeline Execution.mp4

03:43

025 Azure Data Factory - Storage Event Triggers.mp4

11:27

06 - Azure Synapse Analytics - Serverless SQL pool

001 IMPORTANT Download Resources Before Starting.html

001 Section-6-Resources.zip

002 Data Processing - OLAP vs OLTP.mp4

09:10

003 Azure Synapse Analytics - Create a Synapse workspace.mp4

07:37

004 Azure Synapse Analytics - Serverless SQL Pool Introduction.mp4

08:24

005 Serverless SQL pool - Connect with Azure AD User And Azure Data Studio.mp4

09:18

006 Serverless SQL pool - Server Level Credential.mp4

09:55

007 Openrowset - Read Parquet Files.mp4

12:00

008 Openrowset - Read CSV Files.mp4

17:09

009 Openrowset - Read JSON - Line Delimited JSON.mp4

10:54

010 Openrowset - Read JSON - Array of Objects.mp4

07:30

011 Serverless SQL pool - Introduction to External Tables.mp4

05:18

012 Serverless SQL pool - Create External Table - Part I.mp4

06:42

013 Serverless SQL pool - Create External Table - Part II.mp4

09:00

014 Serverless SQL pool - Create External Table III - How to Handle Dirty Records.mp4

07:48

015 Serverless SQL pool - CETAS - Create External Table As Select.mp4

12:55

07 - Azure Synapse Analytics - Serverless Apache Spark pool

001 Apache Spark - Architecture.mp4

11:45

001 Spark-Architecture.pdf

001 useful-links.pdf

002 Create a Serverless Apache Spark Pool.mp4

04:10

003 Create and Run a Spark Notebooks.mp4

08:52

003 synapse-intro-notebook.zip

004 Scaling a Serverless Apache Spark Pool.mp4

07:32

005 Azure Synapse Analytics - Workspace Quotas.mp4

04:54

006 Working with Azure Data Lake Storage.mp4

09:06

007 Working with Azure Blob Storage.mp4

12:33

008 Working with Azure SQL.mp4

11:51

009 Practice - Configure your favorite IDE tool.html

08 - Azure Synapse Analytics - Dedicated SQL Pool

001 Dedicated SQL pool - Introduction.mp4

07:27

001 Dedicated-SQL-Pool-Uselful-Links.pdf

001 notebooks.zip

001 tpcds-onegb.zip

002 Synapse - Create a dedicated SQL pool.mp4

07:10

003 Load data - Copy Statement.mp4

15:09

004 Load data - CREATE TABLE AS SELECT (CTAS).mp4

11:57

005 Star Schema - Architecture of a Data Warehouse.mp4

07:08

006 Hash-distributed table.mp4

08:31

007 Hash-distributed table - Choose the Distribution Column.mp4

07:26

008 Round-robin distributed table.mp4

06:09

009 Practice Create and Load Data into a Dedicated SQL Pool.mp4

01:19

010 Workload Management - How to managed query performance.html

Description

Hands-On Introduction to Azure Data Services. Learn Data Factory, Synapse Analytics, SQL Database, and more

What You'll Learn?

Provision Azure SQL Databases. Use query tools such as Azure Data Studio or SQL Server Management Studio (SSMS) to connect to Azure SQL databases
Create storage accounts to store unstructured and semi-structured data. use Azure Data Studio to upload data to Azure
Manage identities, keys, and secrets across different data platform technologies using Azure Key Vault
Use the Azure CLI to generate Shared Access Signature (SAS). How access storage resources using SAS
Build ETL pipeline using Azure Data Factory. Create advanced transformation logic using Data Flows
Trigger a Data Pipeline based on storage events or specific time
Use T-SQL to query Relational Databases and data in Azure Storage
Transform data using Azure Synapse Analytics. Create external tables to read or write data to files in Azure Storage
Build a modern data warehouse using Azure Synapse Analytics
Analyze data using serverless Apache Spark pool in Synapse Analytics

Who is this for?

Anyone who wants to start using Azure in their career & get paid for their cloud and Data Engineering Skills

Software developers curious about Data Engineering

Database Developer or Database Administrators (DBA)

What You Need to Know?

Microsoft Azure Subscription

Basic SQL knowledge or programming skills

No Data Engineering experience is needed. You will learn everything you need to know

More details

Description
Do you want to jump-start your career as an Azure Data Engineer?

Welcome to the Definitive Guide to Data Engineering on Microsoft Azure.
In this course, you will learn how to use the extensive family of Azure Data Services to build a modern data and analytics platform.
I'll take you step-by-step through engaging video tutorials and teach you everything you need to know to succeed as an Azure Data Engineer.
By the time you complete this course, you will be able to:
Architect a Data Solution on Azure
Integrate relational data and unstructured data
Build data processing pipelines using Azure Data Factory
Integrate and transform data from various data systems
Securely access data stores with Azure Key Vault and Azure role-based access control (Azure RBAC)
Perform exploratory data analysis with Azure Synapse Analytics
Manage your costs
The lectures in this course are hands-on and with lots of explanations.
I also use animations to break down complex topics.
There are SQL scripts and Jupyter notebooks that you can use to follow along easily.

You will be working closely with the documentation of Microsoft Azure as it is essential to know how to find the most up-to-date information about any service.
You will learn how to combine a range of Azure services to ingest, store and process data of all types and sizes from any data source.
Throughout this course, we will learn how to use and combine multiple Azure Services and tools, including:
Azure SQL Databases
Azure Storage
Azure Role-Based Access Control - RBAC
Azure Data Studio
Azure Storage Explorer
Azure Cost Management
Azure Data Factory
Azure Key Vault
Azure Managed Identity
Azure Synapse Analytics
Synapse Workspace
Azure Synapse Studio
Serverless SQL Pool
Serverless Apache Spark Pool
Synapse Analytics Dedicated SQL Pool
At the beginning of each Data Service, you will be introduced to the Service, learn what it is for, and then learn how to use it.
Enroll now, and learn
Microsoft, Windows, Microsoft Azure, and all Azure Data Services are either registered trademarks or trademarks of Microsoft group of companies.
This course is not certified, accredited, affiliated with, or endorsed by Microsoft Corporation.
Who this course is for:
Anyone who wants to start using Azure in their career & get paid for their cloud and Data Engineering Skills
Software developers curious about Data Engineering
Database Developer or Database Administrators (DBA)

User Reviews

Rating

average 0

Total votes0

Focused display

I'm a software developer specialized in building data-intensive applications.I've been developing software for over 10 years.I've worked for Industries that are very data-intensive such as the financials and industrial image processing.Over the years, the volume of data produced by systems and humans outgrew the storage and compute capacity of the legacy RDBMS systems, and therefore I had to learn how to use the new tools and frameworks to process Big-DataAs a data engineer, I'm very motivated and passionate about building applications that can leverage the power and flexibility of cloud computing and big-data processing frameworks.

Udemy

View courses Udemy

Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.