Learning Apache Airflow

Focused View

Janani Ravi

2:10:27

65 View

01 - Introduction

01 - An overview of Apache Airflow.mp4

04:24

02 - 1. Introducing Apache Airflow

01 - Apache Airflow concepts and architecture.mp4

05:53

02 - Initial setup macOS and Windows.mp4

06:08

03 - Understanding Airflow configuration.mp4

03:57

04 - Running Airflow.mp4

03:37

03 - 2. Running Workflows on Airflow

01 - Navigating and exploring the Airflow UI.mp4

06:48

02 - Creating your first DAG.mp4

05:15

03 - Running your first DAG.mp4

05:14

04 - Creating a DAG using the with keyword.mp4

02:15

04 - 3. Defining Tasks and Dependencies

01 - Specifying task dependencies.mp4

04:04

02 - Using the Bitshift operators for dependency specification.mp4

04:53

03 - Using bash scripts in the DAG.mp4

04:55

05 - 4. Using the Python Operator and XCom

01 - Introducing the Python operator.mp4

03:14

02 - Python operators and dependencies.mp4

02:47

03 - Passing parameters to Python callables.mp4

03:17

04 - Introducing XCom.mp4

04:15

05 - Using XCom to pass values.mp4

05:53

06 - Implementing a data transformation DAG pipeline, part 1.mp4

06:30

07 - Implementing a data transformation DAG pipeline, part 2.mp4

04:13

06 - 5. Using the SQLite Operator for SQL Operations

01 - Setting up the SQLite DB and connection.mp4

02:40

02 - Introducing the SQLite operator.mp4

02:31

03 - Implementing a SQL-based DAG pipeline, part 1.mp4

04:05

04 - Implementing a SQL-based DAG pipeline, part 2.mp4

02:29

07 - 6. Conditional Branching and TaskGroups

01 - Introducing branching.mp4

05:14

02 - Conditional branching with variables.mp4

06:48

03 - Task groups and edge labels.mp4

06:42

08 - 7. Catch Up, Backfill, and CRON Expressions

01 - Catch up with all previously scheduled runs.mp4

07:34

02 - Backfill scheduled runs.mp4

03:24

09 - Conclusion

01 - Summary and next steps.mp4

01:28

Description

Get an introduction to Apache Airflow with Google cloud architect and data engineer Janani Ravi. With Apache Airflow—an open-source platform for developing, scheduling, and monitoring batch oriented workflows— you can schedule individual tasks that you want to run as a part of your processing pipeline, specify dependencies between these tasks, all programmatically in Python. Airflow manages these dependencies and ensures that tasks are executed in the right order. Join Janani as she shows you how to run workflows in Airflow, define tasks and dependencies, and use Python and SQLite operators. Learn about conditional branching, and how catch up and backfill work in Apache Airflow.

More details

User Reviews

Rating

average 0

Total votes0

Focused display

Python

Data Science

Janani Ravi

Instructor's Courses

Linkedin Learning

View courses Linkedin Learning

LinkedIn Learning is an American online learning provider. It provides video courses taught by industry experts in software, creative, and business skills. It is a subsidiary of LinkedIn. All the courses on LinkedIn fall into four categories: Business, Creative, Technology and Certifications. It was founded in 1995 by Lynda Weinman as Lynda.com before being acquired by LinkedIn in 2015. Microsoft acquired LinkedIn in December 2016.