Kafka Connect Fundamentals

Focused View

Bogdan Sucaciu

2:14:39

41 View

01.Course Overview

01.01.Course Overview.mp4

01:52

02.Building ETL Pipelines with Apache Kafka

02.01.Introduction.mp4

05:01

02.02.ETL Using Apache Kafka.mp4

02:51

02.03.Kafka Connect.mp4

02:09

02.04.Change Data Capture.mp4

04:43

02.05.Demo Apache Kafka and MySQL.mp4

05:28

02.06.Demo Debezium Connector.mp4

06:01

02.07.Summary.mp4

00:41

03.Exploring Kafka Connect Architecture

03.01.Introduction.mp4

01:38

03.02.Workers.mp4

06:17

03.03.Connectors.mp4

04:12

03.04.Demo Elasticsearch Sink Connector.mp4

06:05

03.05.Tasks.mp4

04:31

03.06.Demo Tasks Rebalancing.mp4

03:31

03.07.Summary.mp4

00:51

04.Building Your Own Connector

04.01.Introduction.mp4

01:50

04.02.Partitioned Streams.mp4

03:49

04.03.Config Validation and Schemas.mp4

03:42

04.04.Demo Config Validation and Schemas.mp4

06:50

04.05.Connectors and Tasks.mp4

04:13

04.06.Demo Connectors and Tasks.mp4

06:31

04.07.Summary.mp4

00:47

05.Data Processing Using Transforms and Converters

05.01.Introduction.mp4

00:37

05.02.Single Message Transforms.mp4

04:35

05.03.Demo Building SMT.mp4

07:56

05.04.Demo Deploying SMT.mp4

03:00

05.05.Converters.mp4

02:51

05.06.Demo Converters.mp4

05:52

05.07.Summary.mp4

00:49

06.Using Kafka Connect in Production

06.01.Introduction.mp4

02:54

06.02.Kafka Connect REST API.mp4

05:01

06.03.Config Provider.mp4

02:30

06.04.MDC Logging.mp4

04:14

06.05.Error Handling.mp4

05:39

06.06.Monitoring and Alerting.mp4

03:00

06.07.Summary and Wrap-up.mp4

02:08

Description

This course is a technical introduction to Kafka Connect and how to use it to quickly transfer data in and out of the Apache Kafka ecosystem, to and from common data systems like databases, key-value stores, search indexes, and file systems.

What You'll Learn?

You may be wondering why the word "Connect" has suddenly sprung up next to "Kafka". Isn’t Kafka a Distributed Streaming Platform? Well, Kafka is more than that. Apache Kafka is an entire ecosystem and Kafka Connect is a part of it. In this course, Kafka Connect Fundamentals, you will gain the ability to create your own real-time ETL pipelines from and to Apache Kafka. First, you will learn what the ETL model is and how to set up your own ETL pipeline using Kafka Connect. Next, you will discover the inner details of Kafka Connect by exploring its architecture. Finally, you will explore how to successfully manage your Kafka Connect installation in a production environment. When you are finished with this course, you will have the skills and knowledge of Kafka Connect needed to set up, build, and maintain your own Kafka Connect installation.

More details

User Reviews

Rating

average 0

Total votes0

Focused display

Apache Kafka

Bogdan Sucaciu

Instructor's Courses

Software Engineer by day, Pluralsight author by night, Bogdan likes to experiment with cutting-edge technologies and teach about them. His favorite talking subjects are streaming data, event-driven architectures, distributed systems, and cloud technologies. He has several years of experience “cooking” software with JVM based languages, some flavors of web technologies, and garnishing with automated testing. He holds a BS in Robotics where he spent countless hours programming microcontrollers and IoT devices and of course, building robots. There, he discovered his passion, designing, and coding complex systems so he pursued his dream and became a self-taught programmer.

Pluralsight

View courses Pluralsight

Pluralsight, LLC is an American privately held online education company that offers a variety of video training courses for software developers, IT administrators, and creative professionals through its website. Founded in 2004 by Aaron Skonnard, Keith Brown, Fritz Onion, and Bill Williams, the company has its headquarters in Farmington, Utah. As of July 2018, it uses more than 1,400 subject-matter experts as authors, and offers more than 7,000 courses in its catalog. Since first moving its courses online in 2007, the company has expanded, developing a full enterprise platform, and adding skills assessment modules.