Apache Airflow Essential Training

Focused View

Janani Ravi

2:14:29

55 View

01 - Introduction

01 - Apache Airflow essential training.mp4

05:36

01 - apache airflow essential training.mp4.zip

02 - 1. Working with the TaskFlow API

01 - Prerequisites.mp4

00:39

02 - Quick Airflow setup overview.mp4

03:27

03 - DAG using PythonOperators.mp4

03:33

04 - DAG using TaskFlow.mp4

03:55

05 - Passing data using XCom with operators.mp4

05:37

06 - Passing data using the TaskFlow API.mp4

04:41

07 - Tasks with multiple outputs.mp4

05:40

08 - Passing multiple outputs in TaskFlow.mp4

01:47

03 - 2. Performing Operations Using TaskFlow

01 - Branching using operators.mp4

06:18

02 - Branching using the TaskFlow API.mp4

04:45

03 - Complete branching pipeline using TaskFlow.mp4

03:17

04 - Interoperating and passing data between operators and TaskFlow.mp4

04:53

05 - Performing SQL operations with TaskFlow.mp4

04:53

06 - Data transformation and storage using TaskFlow.mp4

04:23

04 - 3. Integrating PostgreSQL in Airflow

01 - Installing PostgreSQL on macOS.mp4

02:28

02 - Installing PostgreSQL on WSL.mp4

02:27

03 - Connecting to PostgreSQL.mp4

04:19

04 - Using the PostgreSQL operator.mp4

03:55

05 - Performing PostgreSQL insert operations.mp4

02:44

06 - Performing PostgreSQL join operations.mp4

03:02

07 - A complete end-to-end pipeline with PostgreSQL.mp4

03:48

08 - Configuring PostgreSQL as a metadata database and using the LocalExecutor.mp4

06:06

05 - 4. Using Sensors in Airflow

01 - Introducing the FileSensor.mp4

04:08

02 - Creating a pipeline using the FileSensor.mp4

05:33

03 - Running DAGs with a FileSensor.mp4

03:40

04 - Creating and running a pipeline with SQLSensors.mp4

06:18

06 - 5. Working with Hooks in Airflow

01 - Setting up for a PostgreSQL pipeline with hooks.mp4

02:28

02 - Creating and running a pipeline with PostgresSQL hooks.mp4

06:28

03 - Setting up access to Amazon S3 buckets.mp4

04:32

04 - Setting up a connection to Amazon S3 buckets.mp4

02:05

05 - Creating and running a pipeline with an S3 hook.mp4

05:43

07 - Conclusion

01 - Summary and next steps.mp4

01:21

Description

If you already know the basics of Apache Airflow but are eager to learn more, this course is for you. Certified Google cloud architect and data engineer Janani Ravi guides you through several essential features in Apache Airflow. After a quick review of what Airflow is all about, Janani dives into working with the TaskFlow API and using it to perform a variety of operations. She shows you how to integrate PostgreSQL in Airflow, as well as how to use sensors and work with hooks in Airflow. Level up your use of Apache Airflow with this essential course.

This course was created by Janani Ravi. We are pleased to host this training in our library.

More details

User Reviews

Rating

average 0

Total votes0

Focused display

Data Science

PostgreSQL

Database Programming

Janani Ravi

Instructor's Courses

Linkedin Learning

View courses Linkedin Learning

LinkedIn Learning is an American online learning provider. It provides video courses taught by industry experts in software, creative, and business skills. It is a subsidiary of LinkedIn. All the courses on LinkedIn fall into four categories: Business, Creative, Technology and Certifications. It was founded in 1995 by Lynda Weinman as Lynda.com before being acquired by LinkedIn in 2015. Microsoft acquired LinkedIn in December 2016.