The Ultimate Kafka 3 Real-Time Data Streaming Handson course

Focused View

Big Data Landscape

2:15:06

56 View

1 - Introduction

1 - Introduction.mp4

01:53

2 - Introduction to Data Ingestion

2 - Introduction problematic of Data Ingestion.mp4

03:18

3 - what is Data Ingestion.mp4

02:36

4 - Data Ingestion Tools.mp4

03:00

3 - Introduction to Apache Kafka

5 - Introduction to Kafka Publish Subscribe Architecture.mp4

02:10

6 - Advantages of Apache Kafka.mp4

02:09

4 - Kafka fundamentals

7 - Overview of Kafka components.mp4

02:08

8 - kafka topic.mp4

01:48

9 - Kafka Partitions.mp4

02:22

10 - Kafka Topic Replication.mp4

03:49

5 - Kafka CLI handson

11 - Kafka CLI Handson Introduction.mp4

01:24

12 - Start 3 nodes Kafka Cluster.mp4

03:35

13 - Create Kafka topic with CLI.mp4

03:30

14 - Delete Kafka Topic with CLI.mp4

02:31

15 - Kafka Console CLI Producer and Consumer.mp4

02:54

16 - Apache-Kafka-3-nodes-Cluster.txt

16 - Linux commands used for 3 nodes Kafka Cluster.html

6 - Kafka Handson in python

6 - Quiz.html

17 - Kafka Producer and Consumer Handson in python Introduction.mp4

02:15

18 - Simple Kafka Producer in Python Part 1 coding.mp4

05:53

18 - producer.zip

19 - Kafka Producer in Python Part 2 testing.mp4

01:06

20 - Kafka Consumer in python Part 1 coding.mp4

04:00

20 - consumer.zip

21 - Kafka Consumer in python Part 2 running.mp4

02:09

22 - Complete Kafka Producer Consumer python code resources.html

22 - Python-Kafka-Handson-code.zip

7 - Real World Big Data Ingestion Python Project Streaming Twitter Data with Kafka

23 - The architecture Design of the handson project.mp4

02:29

24 - Real time Data Source Twitter API from Developer Platform.mp4

01:36

25 - Extracting Twitter Data Stream from API in python.mp4

07:04

26 - Create a Tweets Data Kafka Producer.mp4

02:57

27 - Create a Tweets Data Kafka Consumer.mp4

06:22

28 - Kafka Consumer Store Data in Hadoop HDFS.mp4

06:47

29 - Complete Python Code resources Twitter Producer Consumer HDFS Consumer.html

29 - Twitter-Kafka-Handson-Project-code.zip

8 - Real Time Streaming pipeline Handson Kafka Flink ElasticSearch and Kibana

30 - Real Time Streaming Architecture Design Kafka Flink Elasticsearch Kibana.mp4

03:06

31 - Requirement for this project updated versions 3.mp4

01:57

32 - Apache Flink Introduction Apache Spark VS Flink PyFlink.mp4

04:27

33 - Configure Flink to consume data from a Kafka topic as a data source.mp4

11:42

33 - kafka-flink-streaming.zip

34 - Configure Flink to write the processed data to a Elasticsearch sink.mp4

10:37

35 - Real Time Tweets Word Count with pyFlink and Kafka.mp4

21:32

36 - Complete Python Code Streaming pipeline.html

36 - Real-Time-Streaming-pipeline-Handson-code.zip

9 - Real World Project ExerciceSolution

Description

Build End-to-End Real-Time Streaming Pipelines with Kafka, Flink, Elasticsearch & Kibana in Python (Practical Hands on)

What You'll Learn?

Master data ingestion: Efficiently process diverse data streams.
Unleash Kafka's power: Understand core concepts for optimal streaming.
Learn major CLIs: kafka-topics, kafka-console-producer, kafka-console-consumer...
Python + Kafka: Build practical skills for producers, consumers, Topics, Partitions, Brokers, and more.
Create your Producers and Consumers in Python to interact with Kafka
Real-world Twitter data: Ingest and scale data seamlessly into HDFS.
Streamline with Kafka and Flink: Craft end-to-end pipelines for real-time analytics.
Real-time Analytics and Visualization: Master the art of analyzing streaming data and visualizing insights using Elasticsearch and Kibana in your Kafka pipeline

Who is this for?

Developers who want to learn the Data Ingestion, Apache Kafka , Streaming with Apache Flink

Big Data Architects who want to understand how Apache Kafka fits into their solution architecture

Those desiring to build robust streaming pipelines for real-time analytics

Big Data enthusiasts and software developers looking to expand their skill set

Professionals aiming to stay ahead in the rapidly evolving Big Data landscape

Data analysts and professionals in the field of real-time data processing who want to leverage Kafka and Flink for advanced analytics.

Beginners seeking to enter the world of Kafka and Flink streaming and gain practical hands on skills.

Aspiring data engineers and software developers eager to master Kafka, Flink, Elasticsearch, and Kibana for end-to-end real-time analytics pipelines.

Professionals aiming to stay ahead in the dynamic data landscape by acquiring comprehensive skills in real-time data processing and visualization.

What You Need to Know?

Some understanding of Python Programming

Good to have knowledge about Linux command line

Desire to Master Big Data Streaming

Good to have knowledge on big data processing with Flink or Spark

More details

Description
Unleashing the Power of Apache Kafka and Flink: Cutting-Edge Hands-on Experience with real life case studies

This is the only updated Big Data Streaming Course using Kafka with Flink in python !
**(Course newly recorded with Kafka 3.3.1, Flink 1.14.4, ESÂ 7.17.7)

Discover the unrivaled potential of Apache Kafka and the hidden gem of data processing, Flink, in our dynamic course. While Flink may be lesser-known than Spark, it's a powerful tool that surpasses its counterparts in certain aspects.
We'll dive deep into Kafka's core concepts, equipping you with the knowledge to build robust streaming pipelines. But we won't stop there â€“ we'll showcase Flink's prowess as we explore real-time data processing and analytics.
Rest assured, all hands-on exercises are meticulously crafted using the latest versions of Kafka and Flink. Forget about outdated code or compatibility issues â€“ we ensure you're working with cutting-edge tools, ready to conquer the real world.
Although Flink may have a smaller community compared to Spark, this presents a unique opportunity for you to become an early adopter and join the pioneering minds pushing the boundaries of streaming analytics.

We'll guide you step-by-step as you build a complete streaming pipeline that captures live Twitter data, processes it in real-time, and unlocks valuable insights. With our carefully crafted exercises, you'll gain practical experience in ingesting, transforming, and analyzing Twitter data using the latest versions of Kafka and Flink.
Imagine harnessing the pulse of social media to gain actionable insights, all in real-time. From sentiment analysis to trending topics, you'll explore the limitless possibilities of Twitter data analytics.

So, step into the future of stream data processing with Kafka and Flink. Enroll now to gain an edge in the industry, with hands-on expertise on the latest versions of these powerful tools.

*Don't miss out on this transformative learning experience â€“ the world of real-time data awaits!***
Who this course is for:
Developers who want to learn the Data Ingestion, Apache Kafka , Streaming with Apache Flink
Big Data Architects who want to understand how Apache Kafka fits into their solution architecture
Those desiring to build robust streaming pipelines for real-time analytics
Big Data enthusiasts and software developers looking to expand their skill set
Professionals aiming to stay ahead in the rapidly evolving Big Data landscape
Data analysts and professionals in the field of real-time data processing who want to leverage Kafka and Flink for advanced analytics.
Beginners seeking to enter the world of Kafka and Flink streaming and gain practical hands on skills.
Aspiring data engineers and software developers eager to master Kafka, Flink, Elasticsearch, and Kibana for end-to-end real-time analytics pipelines.
Professionals aiming to stay ahead in the dynamic data landscape by acquiring comprehensive skills in real-time data processing and visualization.

User Reviews

Rating

average 0

Total votes0

Focused display

Welcome to my Udemy profile! As an experienced Big Data Engineer with a passion for data-driven solutions, I'm thrilled to share my expertise with you. With years of hands-on experience working with large-scale datasets and a deep understanding of Big Data technologies like Hadoop, Spark, Flink, Airflow, Hbase, Hive, Kafka, and more, I'm committed to helping learners like you unlock the power of Big Data.In my Udemy courses, I've carefully crafted comprehensive yet beginner-friendly content to ensure you gain practical skills and knowledge to tackle real-world Big Data challenges. Whether you're a budding data engineer, a Python developer eager to dive into the world of Big Data, or an enthusiast seeking to leverage the power of data, my courses are tailored to meet your needs.I believe in a hands-on approach, so you can expect engaging exercises and real-world examples that bridge the gap between theory and practice. I'll guide you through step-by-step implementations, empowering you to build end-to-end streaming pipelines using Python and cutting-edge tools. From data ingestion to real-time processing, storage to visualization, you'll gain mastery over the complete pipeline.Join me on this exciting journey to unlock the potential of Big Data. Let's dive deep into the world of data-driven insights and uncover the possibilities that lie within. Enroll in my courses today and embark on a transformative learning experience!

Udemy

View courses Udemy

Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.