Tuning Kafka

Focused View

Janani Ravi

1:57:12

35 View

01 - Introduction

01 - Tuning Kafka.mp4

03:27

02 - 1. Introducing Kafka Tuning

01 - Prerequisites.mp4

01:01

02 - An overview of Kafka.mp4

05:47

03 - Producers and consumers.mp4

03:41

04 - Kafka optimization theorem.mp4

06:17

05 - End-to-end latency in Kafka.mp4

02:33

06 - Install and set up Apache Kafka.mp4

03:47

07 - Publish and consume messages using console scripts.mp4

02:54

03 - 2. Tuning Kafka Producers

01 - Running a Kafka cluster with three brokers.mp4

05:33

02 - Running basic producer performance tests.mp4

06:42

03 - Effects of partitioning on producers.mp4

06:42

04 - Effects of replication on producers.mp4

04:13

05 - Tuning producer acks.mp4

06:39

06 - Tuning producer compression.mp4

06:39

07 - Tuning batch size and linger time.mp4

05:17

08 - Effect of message size and record count.mp4

05:27

04 - 3. Tuning Kafka Consumers

01 - Running a basic consumer performance test.mp4

04:24

02 - Tuning fetch bytes and wait time for consumers.mp4

06:14

03 - Tuning session timeout and heartbeat interval.mp4

02:58

04 - Tuning max poll interval and max poll records.mp4

03:06

05 - 4. Tuning Kafka Brokers

01 - End-to-end latency with replication.mp4

06:06

02 - Tuning throughput.mp4

05:23

03 - Tuning log retention.mp4

03:29

06 - 5. Performance Testing with Python

01 - Producer performance testing using Python.mp4

04:52

02 - Consumer perf testing using Python.mp4

03:04

07 - Conclusion

01 - Summary and next steps.mp4

00:57

Description

Looking to take your skills to the next level with Apache Kafka? If you’re an experienced Kafka user, you probably already know that the performance of your Kafka environment is affected by many factors. But how do you tune them? In this course, instructor Janani Ravi shows you how to fine-tune Kafka using the Kafka optimization theorem and other powerful tuning tools.

Get an introduction to Kafka tuning, how it affects producers and consumers, and how to set up Kafka on your machine so you can start publishing messages. Explore the basics of tuning Kafka producers such as running a cluster with multiple brokers, running performance tests, partitioning, replication, compression, batch size, and more. Discover the essentials of tuning Kafka consumers with basic performance tests, fetch bytes and wait time, session timeout, max poll intervals and records, end-to-end latency, and throughput. By the end of this course, you’ll also be prepared to run performance tests using Python.

This course was created by Loonycorn. We are pleased to host this content in our library.

More details

User Reviews

Rating

average 0

Total votes0

Focused display

Apache Kafka

Janani Ravi

Instructor's Courses

Linkedin Learning

View courses Linkedin Learning

LinkedIn Learning is an American online learning provider. It provides video courses taught by industry experts in software, creative, and business skills. It is a subsidiary of LinkedIn. All the courses on LinkedIn fall into four categories: Business, Creative, Technology and Certifications. It was founded in 1995 by Lynda Weinman as Lynda.com before being acquired by LinkedIn in 2015. Microsoft acquired LinkedIn in December 2016.