The Complete Apache Kafka Practical Guide

Focused View

Bogdan Stashchuk | Software Engineer, MBA, PhD

8:36:05

13 View

01 - Introduction

001 Lets get connected! Join the Learning Community.html

02 - Apache Kafka Installation Overview

001 Apache Kafka Installation Overview.mp4

01:05

002 Installing Apache Kafka on the Mac and Unix-like systems.mp4

00:52

003 Installing Apache Kafka on the Mac.mp4

05:24

004 Installing Ubuntu on MacOS using VirtualBox.mp4

12:40

03 - Installing Apache Kafka on the remote Ubuntu server

001 SECTION 2 Introduction.mp4

00:59

002 Creating remote Ubuntu Virtual Private Server.mp4

06:15

003 Installing Apache Kafka on Virtual Private Server.mp4

07:04

04 - Installing Apache Kafka on Windows

001 SECTION 3 Introduction.mp4

01:02

002 Installing Apache Kafka on Windows.mp4

08:25

003 Starting Zookeeper and Kafka server on Windows.mp4

06:31

004 Installing Ubuntu on Windows using VirtualBox.mp4

11:38

005 Installing Apache Kafka on Ubuntu using GUI.mp4

06:15

05 - Starting Apache Zookeeper and Kafka Broker

001 SECTION 4 Introduction.mp4

01:02

002 Observing contents of the Kafka folder.mp4

05:55

003 Reading and editing Kafka files using VisualStudio Code.mp4

06:19

004 Trying to start Kafka Server.mp4

04:10

005 Observing Kafka Server logs.mp4

01:42

006 Starting Zookeeper.mp4

03:12

007 Starting Kafka Server while Zookeeper is up and running.mp4

06:11

008 Observing logs folder and current kafka server setup.mp4

04:43

06 - Creating and exploring Kafka Topic

001 SECTION 5 Introduction.mp4

00:29

002 How to connect to Kafka cluster.mp4

02:18

003 Create new Kafka topic.mp4

05:04

004 What happened after creation of the new topic.mp4

03:35

005 Read details about topic.mp4

05:21

07 - Producing and consuming Messages

001 SECTION 6 Introduction.mp4

00:43

002 Send some messages using Kafka Console Producer.mp4

03:12

003 Consuming messages using Kafka Console Consumer.mp4

03:18

004 Consuming messages from the beginning.mp4

01:35

005 Running multiple consumers.mp4

01:30

006 Running multiple producers.mp4

03:13

007 What was changed in the Kafka logs.mp4

09:32

08 - What is Apache Kafka and how it works

001 SECTION 7 Introduction.mp4

01:35

002 What is Apache Kafka.mp4

04:00

003 Broker.mp4

02:27

004 Broker cluster.mp4

01:53

005 Zookeeper.mp4

01:58

006 Zookeeper ensemble.mp4

03:29

007 Multiple Kafka clusters.mp4

02:19

008 Default ports of Zookeeper and Broker.mp4

03:48

009 Kafka Topic.mp4

02:31

010 Message structure.mp4

03:33

011 Topics and Partitions.mp4

04:33

012 Spreading messages across partitions.mp4

05:27

013 Partition Leader and Followers.mp4

06:23

014 Controller and its responsibilities.mp4

05:16

015 How Producers write messages to the topic.mp4

02:14

016 How Consumers read messages from the topic.mp4

03:33

09 - GitHub Repository and Diagrams for the course

001 SECTION 8 Introduction.mp4

00:45

002 GitHub repository and list of basic Kafka commands.mp4

07:32

003 Diagrams for the course.mp4

03:42

10 - EXAMPLE 1 - Topic with Multiple Partitions

001 SECTION 9 Introduction.mp4

00:52

002 If you use remote Kafka brokers.html

003 Cleaning up existing kafka installation.mp4

02:13

004 Creating topic with multiple partitions.mp4

05:59

005 How messages were spread across different partitions.mp4

06:19

006 Reading messages from specific partition.mp4

02:44

007 Reading messages from specific offset in specific partition.mp4

05:44

008 Reading details about topic and consumer offsets topic.mp4

06:45

009 Summary for multiple partitions example.mp4

01:56

11 - EXAMPLE 2 - Kafka Cluster with Multiple Brokers

001 SECTION 10 Introduction.mp4

00:57

002 Example overview - run multiple brokers.mp4

01:25

003 Creating separate configuration files for brokers.mp4

05:34

004 Launching three brokers.mp4

02:40

005 Getting cluster information and broker details from Zookeeper.mp4

02:47

006 Creating multiple-partition topic in the Kafka cluster.mp4

03:16

007 Looking at logs folders of every broker.mp4

02:13

008 Producing and consuming messages in the cluster.mp4

03:33

009 Details about topic in the cluster.mp4

03:27

010 Simulating broker failure in the cluster.mp4

05:54

011 Summary for broker cluster and topic without replication.mp4

01:45

12 - EXAMPLE 3 - Multiple Brokers and Topic with Replication

001 SECTION 11 Introduction.mp4

01:23

002 Preparing for the next example with replication.mp4

02:41

003 Launching brokers and creating topic with replication.mp4

04:41

004 Observing logs folder and details of the topic.mp4

06:05

005 Producing and consuming messages in the topic with replication.mp4

06:09

006 Observing how messages were stored in the partitions on different brokers.mp4

03:05

007 Bringing down one of three brokers and observing changes.mp4

03:33

008 Bringing down another broker in the cluster.mp4

03:44

009 Bringing back both brokers.mp4

01:57

010 Summary for replication.mp4

01:36

13 - EXAMPLE 4 - Kafka Consumer Groups

001 SECTION 12 Introduction.mp4

00:51

002 Example with consumer groups overview.mp4

01:00

003 Exploring default consumer groups.mp4

10:00

004 Starting consumer in the custom consumer group.mp4

08:12

005 Starting second consumer in the same consumer group.mp4

04:40

006 Launching one more consumer in the same group.mp4

01:59

007 Idle consumers in the group.mp4

05:51

008 Summary for consumer groups.mp4

01:48

14 - EXAMPLE 5 - Performance Testing

001 SECTION 13 Introduction.mp4

00:48

002 Overview of the performance testing example.mp4

01:18

003 Starting cluster and launching basic performance test.mp4

04:22

004 Increasing performance test parameters.mp4

02:51

005 Testing consumer performance.mp4

03:18

006 Getting non-zero LAG values for consumers.mp4

05:18

007 Performance test example summary.mp4

00:58

15 - PROJECT 1 - Java

001 SECTION 14 Introduction.mp4

01:45

002 If you use remote Kafka brokers.html

003 Project Files for the Java section.mp4

01:05

004 Installing IntelliJ editor.mp4

03:22

005 Creating and configuring Maven project.mp4

05:40

006 Starting Kafka Cluster.mp4

01:38

007 Creating Java Producer.mp4

07:04

008 Continue Creating Java Producer.mp4

07:06

009 Launching Java Producer.mp4

05:04

010 Explaining most common Producer parameters.mp4

12:04

011 Modifying Serializer type.mp4

05:27

012 Producing meaningful messages with delay.mp4

06:06

013 Refactoring Producer by adding previous example.mp4

02:52

014 Creating consumer with autocommitting - PART 1.mp4

07:48

015 Creating consumer with autocommitting - PART 2.mp4

08:31

016 Consumer parameters overview.mp4

06:24

017 Consumer with Manual Committing.mp4

10:33

018 Consumer with Partitions Assignment.mp4

05:36

019 Launching multipile consumers in the same consumer group.mp4

07:41

020 CHALLENGE - Subscribe vs Assign with consumer groups.mp4

01:54

16 - PROJECT 2 - Node.js

001 SECTION 15 Introduction.mp4

00:54

002 If you use remote Kafka brokers.html

003 Installing Node.js with NPM.mp4

01:55

004 Starting up Kafka cluster with 3 brokers.mp4

02:20

005 Initializing Node.js project.mp4

01:37

006 Final Node.js project files.mp4

01:14

007 Creating basic Node.js producer.mp4

07:02

008 Producing random animal names.mp4

06:42

009 Creating Node.js consumer.mp4

04:53

17 - PROJECT 3 - Python

001 SECTION 16 Introduction.mp4

00:43

002 If you use remote Kafka brokers.html

003 Installing Python.mp4

01:40

004 Final Python project files.mp4

00:43

005 Launching basic Python producer.mp4

05:35

006 Launching consumer and receiving messages.mp4

03:36

007 Generating fake names in the messages by producer.mp4

06:01

18 - Course Summary

001 Course Summary.mp4

01:07

002 Bonus Lecture.html

Description

Learn core Apache Kafka features, create Java, Node.js, Python Producers and Consumers - Full Kafka hands-on experience!

What You'll Learn?

Understand how Apache Kafka works
Create fault-tolerant clusters with topics replication across multiple brokers
Apache Kafka Architecture
How to create Kafka cluster with multiple Brokers
Practice to create producers and consumers using built-in console producer and console consumer
Write custom producer and consumer in Java
Use Python and Node to produce and consume messages
Learn components of the Apache Kafka Cluster

Who is this for?

Beginners who want to learn Apache Kafka

Advanced Apache Kafka users who want to learn how to build producers and consumers in other languages like Node or Python

This course is for you if you want to PRACTICE using Kafka and it's APIs

What You Need to Know?

You could have completely no prior knowledge about Apache Kafka

Prepare only your Mac, Windows or Linux/Unix computer. Anything will work.

Also you could know nothing about Java, Node or Python. I will explain all of these from beginning

We will start from the very beginning by installing Apache Kafka and exploring it's components

More details

Description
This course is all about Apache Kafka
Understand HOW Apache Kafka works and learn its core features ONÂ PRACTICE. This is 80% practice course without no useless demos!
Build custom Apache Kafka Producers and Consumers using native Java API. Also you will build projects using APIs for other programming languages like Node.js and Python.
Become a master of Apache Kafka by understanding and practicing its architecture and main features.
All project files and mostly used commands are available in the GitHub repository.
This is the most complete practical Apache Kafka guide here on Udemy that includes tons of practical activities. Most important is that you will learn how Apache Kafka works and knowing it you will be able much more easier use its features and fix mistakes in the future after you'll finish this course. You can have zero knowledge about Apache Kafka, Java, Node.js or Python. All will be taught from scratch, from basic to advanced features. If you want to get deep knowledge of Apache Kafka this course is for you!

We will start by installing Apache Kafka on your computer, VPS (Virtual Private Server) or Virtual Machine on your computer. You will learn that installation of Apache Kafka is pretty easy - you just need to download archive with executable scripts and run them.Â Also you will learn and practice how to run multiple brokers on the same computer.
Afterwards we will jump into tons of practice activities and use different Apache Kafka features and built-in scripts. You will launch Zookeeper, multiple Brokers, Console Consumer and Console Producer. Also you will test performance of the Kafka Cluster using built-in utility called Performance Monitor.
In practice sections you will perform multiple practice Apache activities:
Create cluster with multiple brokers
Create topic with multiple partitions spread across different brokers
Create topics with replication factor that allows you to store copy of every message on different brokers for redundancy
Produce messages using built-in Console Producer
Consume messages using built-in Console Consumer
Launch multiple consumers in the same consumer group
Launch Performance Monitor for testing Consumers and Producers performance and speed
You will also learn and practice how to use Apache Kafka API to create your own Consumers and Producers
Create Java Maven project
Launch Producer and Consumer using Java
Launch multiple consumers in the same Consumer Group
Understand and practice difference between "subscribe" and "assign"
Create Node.js project
Launch Producers and Consumers using Node.js
Create Python project
Launch Producers and Consumers using Python
During the course you will need to view and edit text files. For that you will NOT use terminal. Instead you will use GUI application VisualStudio Code. Also all configuration files and project files are available in the GitHub repository. This means that during this course you will also learn how to use :
Git and GitHub
VisualStudio Code
With this course you will get lifetime-long access to more than 100 lectures and tens of practical exercises. After the course you will become a guru of Apache Kafka and will be able easily create custom Apache Kafka Producers and Consumers.
But most important is that you will UNDERSTAND Apache Kafka.
You will also get 30-days money-back guarantee. No questions asked!
Don't wait and join the course now!
Who this course is for:
Beginners who want to learn Apache Kafka
Advanced Apache Kafka users who want to learn how to build producers and consumers in other languages like Node or Python
This course is for you if you want to PRACTICE using Kafka and it's APIs

User Reviews

Rating

average 0

Total votes0

Focused display

Apache Kafka

Bogdan Stashchuk | Software Engineer, MBA, PhD

Instructor's Courses

Do you really want to understand and practice instead of sitting and watching long presentations or trying to code along without any clue what is happening behind the scenes?Join me in any of my courses and you will get real knowledge based on the deep understanding of every single topic.But who am I?My name is Bogdan Stashchuk and I teach students more than 20 years. I am working as Software Engineer and love to teach and learn myself.I have a huge experience in explaining difficult things in an easy to understand format backed up with practice activities. That is the perfect combination that enables you to really learn and retain gained knowledge for a long period of time.Let's connect in the Social Networks! All links you could find under the profile picture.See you on my courses!

Udemy

View courses Udemy

Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.