Reactive Kafka From Scratch

Focused View

Vinoth Selvaraj

11:38:43

98 View

1. Introduction

1. Introduction.mp4

02:17

2. Need For Event Driven Architecture Kafka.mp4

08:03

3. Resource Download.html

2. Kafka Setup

1. Introduction.mp4

05:26

2. Custom Docker Image.mp4

05:37

3. Docker Compose Setup.mp4

05:49

3. Kafka Crash Course

1. Introduction.mp4

03:22

2. Cluster.mp4

06:12

3. Bootstrap Server.mp4

03:22

4. Topic Command.mp4

05:43

5. Exploring Data Directory.mp4

02:30

6. Documenting Commands.mp4

01:23

7. Console Producer.mp4

02:39

8. Console Consumer.mp4

02:38

9. Producer & Consumer Side By Side.mp4

03:50

10. [Properties] linger.ms vs batch.size.mp4

03:10

11. Consumer Push vs Pull.mp4

03:15

12. Serialization vs Deserialization.mp4

01:38

13. [Properties] Log Retention.mp4

01:19

14. Offset.mp4

03:41

15. Message Timestamp.mp4

01:13

16. 2 Consumers Demo.mp4

03:22

17. Consumer Group.mp4

03:32

18. Consumer Group - Demo.mp4

05:27

19. Need For Message Ordering.mp4

02:50

20. Partition & Key.mp4

07:33

21. Who is calculating the Partition.mp4

01:30

22. Topic With 2 Partitions.mp4

03:37

23. Consumer Group Demo with Partitions - Part 1.mp4

04:53

24. Consumer Group Demo with Partitions - Part 2.mp4

03:40

25. Consumer Group Scaling - Scenarios.mp4

06:17

26. Consumer Group - LAG.mp4

05:58

27. Multiple Consumer Group - LAG.mp4

01:40

28. Resetting Offset.mp4

03:06

29. Resetting Offset - Demo.mp4

08:14

30. Message Format.mp4

02:41

31. Summary.mp4

05:47

4. Reactor Kafka

1. Maven Dependencies.html

2. Project Setup.mp4

03:06

3. Consumer Config.mp4

09:59

4. Creating Kafka Receiver.mp4

04:24

5. Kafka Receiver Demo.mp4

03:21

6. Auto Offset Reset.mp4

03:31

7. Session Timeout Config.mp4

04:36

8. Acknowledging Message.mp4

07:17

9. Enabling Auto Commit.mp4

01:22

10. Will Messages Be Redelivered.mp4

01:35

11. Out Of Order Commit.mp4

01:58

12. Consume From Multiple Topics.mp4

03:50

13. Kafka Producer Config.mp4

03:52

14. Creating Sender Record.mp4

06:48

15. Kafka Producer Demo.mp4

00:53

16. Sender Close.mp4

02:26

17. Receiver Close.mp4

00:38

18. Emitting 1 Million Events.mp4

04:34

19. Max In Flight.mp4

04:21

20. Message Headers.mp4

06:13

21. Consumer Group Demo - Part 1.mp4

04:04

22. Consumer Group Demo - Part 2.mp4

05:42

23. Cooperative Sticky Assignor.mp4

05:20

24. Range Assignor.mp4

01:53

25. Seeking Offset.mp4

06:40

26. Summary.mp4

00:50

5. Kafka Cluster

1. Introduction.mp4

04:54

2. Quick Note On Listeners.mp4

02:05

3. Cluster Properties.mp4

13:14

4. Cluster Demo.mp4

06:01

5. Kafka Fault Tolerance Demo.mp4

07:29

6. Summary.mp4

00:53

6. Best Practices

1. Producer acks.mp4

06:01

2. min.insync.replica.mp4

03:26

3. Idempotent Producer.mp4

03:30

4. Producing Duplicate Messages.mp4

01:39

5. Idempotent Consumer.mp4

03:39

6. Compression.mp4

03:31

7. How Many Topics Should I Create.mp4

02:02

8. How Many Partitions Should I Create.mp4

04:17

9. How Many Replication Factor Should I Have.mp4

02:19

10. Summary.mp4

03:06

7. Batch Parallel Processing

1. Introduction.mp4

03:10

2. Batch - Receiver Auto Ack concatMap.mp4

07:43

3. Parallel - flatMap.mp4

03:19

4. Schedulers with FlatMap.mp4

01:20

5. Message Ordering Issue With FlatMap.mp4

04:11

6. GroupedFlux - Parallel and Message Ordering - Part 1.mp4

04:24

7. GroupedFlux - Parallel and Message Ordering - Part 2.mp4

05:01

8. Summary.mp4

01:20

8. Error Handling

1. Introduction.mp4

04:00

2. Simple Retry.mp4

03:23

3. Separating Receiver & Processor - Theory.mp4

03:08

4. Separating Receiver & Processor - Implementation - Part 1.mp4

05:41

5. Separating Receiver & Processor - Implementation - Part 2.mp4

03:20

6. Separating Receiver & Processor - Implementation - Part 3.mp4

01:52

7. Retry Depending On Error.mp4

08:37

8. Dead Letter Topic - Introduction.mp4

04:12

9. Reactive Dead Letter Topic Producer - Part 1.mp4

06:42

10. Reactive Dead Letter Topic Producer - Part 2.mp4

06:48

11. Order Event Processor.mp4

04:33

12. Code Cleanup.mp4

04:04

13. Dead Letter Topic Demo.mp4

05:17

14. Poison Pill Messages.mp4

05:54

15. Poison Pill Messages - Fix.mp4

06:04

16. Error Handling At Producer Side.mp4

06:11

17. Summary.mp4

03:21

9. Kafka Transaction

1. Introduction.mp4

04:31

2. Demo App Walkthrough.mp4

01:42

3. Transfer Event Consumer.mp4

06:38

4. Transfer Event Processor - Part 1.mp4

06:47

5. Transfer Event Processor - Part 2.mp4

07:33

6. Transfer Config.mp4

04:21

7. Adding Delay.mp4

00:43

8. Kafka Commands.mp4

02:48

9. Kafka Transaction Demo.mp4

07:29

10. How Kafka Transaction Works.mp4

07:46

11. read committed vs read uncommitted.mp4

00:48

12. Send Transactionally.mp4

01:25

13. Producer Fenced Exception.mp4

03:05

14. Delivery Semantics.mp4

03:41

10. Reactive Kafka With Spring

1. Introduction.mp4

06:53

2. Simple Spring Kafka Consumer.mp4

02:41

3. Order Event DTO.mp4

03:46

4. Spring Kafka Producer Config.mp4

06:12

5. Order Event Decoding Issue.mp4

01:23

6. Importance Of Type ID.mp4

03:30

7. Order Event Demo.mp4

02:04

8. Printing Type ID Header.mp4

02:38

9. Decoding As Custom Object.mp4

04:05

10. Summary.mp4

04:40

11. Integration Testing

1. Introduction.mp4

01:01

2. Embedded Kafka Test.mp4

06:40

3. Embedded Kafka Demo.mp4

04:04

4. Embedded Kafka Random Port.mp4

03:06

5. Project Restructure.mp4

03:19

6. Abstract Integration Test - Utilities - Part 1.mp4

05:05

7. Abstract Integration Test - Utilities - Part 2.mp4

02:57

8. OrderEventProducer - Test.mp4

05:53

9. OrderEventProducer - Demo.mp4

02:44

10. @DirtiesContext.mp4

03:12

11. Creating Sender Util.mp4

04:32

12. OrderEventConsumer - Demo.mp4

07:23

12. ASSIGNMENT

1. Introduction.mp4

07:02

2. R2DBC - Persistable Interface.mp4

03:09

3. ASSIGNMENT .mp4

01:40

4. [ASSIGNMENT SOLUTION] - Product Service Setup.mp4

03:58

5. [ASSIGNMENT SOLUTION] - Product Service - Implementation - Part 1.mp4

08:47

6. [ASSIGNMENT SOLUTION] - Product Service - Implementation - Part 2.mp4

03:48

7. [ASSIGNMENT SOLUTION] - Product Service - Integration Test - Part 1.mp4

07:46

8. [ASSIGNMENT SOLUTION] - Product Service - Integration Test - Part 2.mp4

03:33

9. [ASSIGNMENT SOLUTION] - Analytics Service - Setup.mp4

04:24

10. [ASSIGNMENT SOLUTION] - Analytics Service - Implementation - Part 1.mp4

05:47

11. [ASSIGNMENT SOLUTION] - Analytics Service - Implementation - Part 2.mp4

12:24

12. [ASSIGNMENT SOLUTION] - Analytics Service - Implementation - Part 3.mp4

07:26

13. [ASSIGNMENT SOLUTION] - Analytics Service - Integration Test - Part 1.mp4

06:57

14. [ASSIGNMENT SOLUTION] - Analytics Service - Integration Test - Part 2.mp4

07:06

15. Final Demo.mp4

07:42

16. Final Demo With Companion Flux.mp4

04:56

13. Kafka Security

1. Introduction.mp4

09:25

2. App With Kafka Credentials.mp4

06:44

3. SSL Introduction.mp4

04:03

4. Kafka SSL.mp4

05:38

5. Kafka SSL Demo.mp4

03:43

14. Thank you

1. Whats Next.mp4

01:32

Description

Getting Started With Event Driven Microservices

What You'll Learn?

Learn Kafka From Scratch
Spring Kafka - Event Driven Microservices
Batch & Parallel Processing
Kafka Transaction
Writing Integration Tests
Best Practices

Who is this for?

Any senior / staff level engineer

More details

Description
Â Reactive Spring Kafka - Getting Started With Event Driven Microservices
This course is particularly for any senior or staff level engineer who wants to learn Reactive Kafka From Scratch. By the end of the course, you will become very comfortable with Kafka.
Here is what we will do in this course:
Kafka
Setting up Kafka - latest KRaft mode using custom docker image
Bootstrap Server
Various Kafka Topic commands and Options
Console Producer
Console consumer
Various Kafka properties
How apps publish and consume messages
How serialization and Deserialization works in Kafka
How Kafka Log Retention works
Offset and How to reset Offset to consume messages from specific time
Message Format
How to scale Applications using Kafka Consumer Group
Message Ordering
Kafka With Reactive Programming
Creating a simple Java Kafka producer and consumer applications using reactive programming
Various producer and consumer configuration
Auto offset reset
How to acknowledge the messages
Emitting millions events to check the performance
Seeking offset
Partition assignment strategy
Cooperative sticky assignor
Range assignor
Kafka Cluster
How cluster works
Setting up Kafka cluster using docker compose
Kafka cluster - Fault tolerance demo. How producer and consumer applications work without any issues when Kafka brokers go up and down.
Best Practices
What is producer acknowledge and why we should do that?
Min in sync replicas
Creating idempotent producer
Creating idempotent consumer to take care of duplicate messages
Compression - to reduce the size of messages and improve the throughput
Discussing Common Questions
How many topics should I create?
How many partitions should I create?
How many replicas should I have?
Batch / Parallel Processing
Consuming messages in parallel and proper order to make use of all the CPUs.
Error Handling
Retry
Dead Letter Topic
Poison Pill Messages
Kafka Transaction
How to produce and consume messages in transactional mode (like Database Transaction)
Integration Tests
Developing integration tests using Embedded Kafka
Kafka Security
Plain Credentials
SSL
Assignment
Lets test our learning by developing a couple of Microservices communicating via Kafka Topic to analyze the user behaviors and provide metrics to Business team on Product Trending.

Who this course is for:
Any senior / staff level engineer

User Reviews

Rating

average 0

Total votes0

Focused display

Vinoth has been working as a Principal Engineer and he is an AWS certified solution architect associate & Certified Kubernetes Application Developer.He has a passion for software development, Microservice Architecture, framework creation, setting up best practices, test automation, creating custom tools for team’s productivity / process improvement, devops etc.Huge fan of JVM technologies, Spring, NodeJS, Docker, Kubernetes etc.

Udemy

View courses Udemy

Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.