The Big Data Developer Course

Focused View

Deesa Technologies

32:53:56

99 View

1. Introduction to the course

1. What is this course about.mp4

04:54

2. How to make best use of this course.mp4

05:55

2. Introduction to the Big Data World

1. Introduction to Hadoop.mp4

12:54

2. How MapReduce works.mp4

08:48

3. What is Big Data.mp4

06:22

4. [Notes] What is Big Data.html

5. Hadoop 1.0 Architecture.mp4

22:15

6. Hadoop 2.0 Architecture.mp4

15:24

7. Hadoop 3.0 Architecture.mp4

09:01

3. Setting up Cluster and doing hands on with Hadoop

1. Cloudera Software Installation.mp4

28:31

2. [Notes] Cloudera Software Installation.html

3. Hadoop Commands.mp4

25:31

4. [Notes] Hadoop Commands.html

5. Row Storage vs Column Storage.mp4

11:06

6. Serialized File Formats.mp4

16:06

7. [Notes] Serialized File Formats.html

4. Sqoop

1. Sqoop Introduction.mp4

07:43

2. Sqoop Import.mp4

09:51

3. [Notes] sqoop import.html

4. Sqoop Multiple Mappers.mp4

09:06

5. [Notes] Sqoop Multiple Mappers.html

6. import portion of data.mp4

15:51

7. [Notes] import portion of data.html

8. Sqoop eval and change the file delimiter.mp4

05:19

9. [Notes] Sqoop eval and change the file delimiter.html

10. incremental import.mp4

18:11

11. [Notes] incremental import.html

12. Password Protection.mp4

10:21

13. [Notes] Password Protection.html

14. Using Last Modified.mp4

12:32

15. [Notes] Using Last Modified.html

16. Import multiple File Formats.mp4

12:55

17. [Notes] Import multiple File Formats.html

18. Import multiple Tables.mp4

07:29

19. [Notes] Import multiple Tables.html

20. Handling Null during Import.mp4

05:24

21. [Notes] Handling Null during Import.html

22. Sqoop export.mp4

06:14

23. [Notes] Sqoop export.html

24. Sqoop Performance Tuning.mp4

06:31

25. [Notes] Sqoop Performance Tuning.html

5. Hive

1. Hive-Data Preparation.mp4

20:58

2.1 america.zip

2.2 countries.zip

2.3 india.zip

2. [Notes] Hive-Data Preparation.html

3. What is Hive.mp4

07:15

4. [Notes] What is Hive.html

5. Create and load a table in Hive.mp4

33:44

6. [Notes] Create and load a table in Hive.html

7. Hive Table Types.mp4

04:50

8. [Notes] Hive Table Types.html

9.1 america.zip

9.2 countries.zip

9.3 india.zip

9. Hive Partitions.mp4

49:08

10.1 america.zip

10.2 countries.zip

10.3 india.zip

10. [Notes] Hive Partitions.html

11. Hive Use Case.mp4

05:15

12. [Notes] Hive Use Case.html

13. Hive Buckets.mp4

15:43

14. [Notes] Hive Buckets.html

15. Schema Evolution in Hive.mp4

27:38

16. [Notes] Schema Evolution in Hive.html

17. Execute hive queries using a script.mp4

05:23

18. [Notes] Execute hive queries using a script.html

19. Working with Dates in Hive.mp4

05:15

20. [Notes] Working with Dates in Hive.html

21. Joins in Hive.mp4

23:43

22. [Notes] Joins in Hive.html

23. MSCK Repair.mp4

06:03

24. [Notes] MSCK Repair.html

25. Performance Tuning in Hive.mp4

04:36

26. [Notes] Performance Tuning in Hive.html

27. Hive vs SQL.mp4

01:35

28. [Notes] Hive vs SQL.html

29.1 hive notes.zip

29.2 hive queries.zip

29.3 hivebuiltinfunctions.zip

29. Hive Additional Resources.mp4

04:58

6. Installation for Spark and Scala

1. Installing and setting up Spark and Scala.mp4

12:44

2. [Notes] Installing and setting up Spark and Scala - Download links.html

7. Lets learn Scala

1. Introduction to Scala.mp4

02:44

2. Executing our First Scala Program.mp4

13:25

3. Scala Basics.mp4

29:14

4. Conditional Statements.mp4

23:14

5. Loops in Scala.mp4

22:48

6. Functions in Scala.mp4

19:05

7. Scala Class.mp4

12:24

8. Scala Inheritance Introduction.mp4

02:35

9. Single Inheritance.mp4

08:28

10. Multilevel Inheritance.mp4

05:18

11. Hierarchical Inheritance.mp4

05:15

12. Scala Traits - for Mutliple Inheritance.mp4

05:57

13. Hybrid Inheritance.mp4

02:59

14. Method overriding and Method Overloading.mp4

12:13

15. Singleton and Companion Object.mp4

04:53

16. Case Class.mp4

04:16

17. Abstraction and Final.mp4

09:10

18. Higher Order Functions and Lambda Expressions.mp4

11:08

19. What is Partially Applied Function.mp4

06:57

20. What is Currying.mp4

03:11

21. What is Option Type.mp4

10:56

22. Pattern Matching in Scala.mp4

12:46

23. Exception Handling in Scala.mp4

15:36

24. Scala Collections.mp4

44:26

25. [Notes] Scala Collections.html

26. Collection Methods.mp4

36:47

27. [Notes] Collection Methods.html

28. Group By vs Grouped.mp4

06:30

29. Variable Arguments - What is it and how is it useful .mp4

05:36

30. Working with Files.mp4

17:13

8. Introduction to Spark

1. What is Spark.mp4

06:58

2. Why is Spark Faster than MapReduce.mp4

11:35

9. Spark RDDs

1. RDD Basics - Reading and Writing a File.mp4

28:59

2. [Notes] RDD Basics - Reading and Writing a File.html

3. Deploying code to Cluster.mp4

14:21

4. Use Case - Analyze the Log Data.mp4

16:03

5. [Notes] Use Case - Analyze the Log Data.html

6. Common RDD Transformations and Actions.mp4

26:11

7.1 sales.zip

7. What is Pair RDD.mp4

20:22

8.1 words.zip

8. Use Case - The word count example.mp4

05:36

9. Using Schema RDD.mp4

13:14

10. Using Row RDD.mp4

04:28

10. Spark DataFrames

1. What is Spark DataFrame.mp4

02:29

2. Creating DataFrames from RDD.mp4

33:25

3. Spark Seamless Dataframe- Reading and Writing.mp4

30:50

4. [Notes] Spark Seamless Dataframe- Reading and Writing.html

5.1 spark-avro_2.11-4.0.0 (1).zip

5. Reading and Writing AVRO Data.mp4

16:11

6.1 commons-io-2.8.0 (1).zip

6.2 spark-xml_2.11-0.11.0 (1).zip

6.3 txw2-2.3.3 (1).zip

6.4 xmlschema-core-2.2.5 (1).zip

6. Reading and Writing XML Data.mp4

14:31

7. [Notes] Reading and Writing XML Data.html

8.1 random_user.zip

8.2 user.zip

8. Reading Multi Lines Json.mp4

10:18

9. [Notes] Reading Multi Lines Json.html

10. Write Modes in Spark.mp4

08:00

11. Passing schema to a file.mp4

14:35

12. Applying Transformations using tempView and DSL.mp4

17:40

11. Spark Advance

1. Lets explore more transformations.mp4

46:32

2. [Notes] Lets explore more transformations.html

3. How to remove duplicates.mp4

12:35

4. Sorting the Data.mp4

16:34

5.1 account.zip

5. Handling Nulls in Spark.mp4

17:46

6. Working with String Functions.mp4

20:15

7. Working with Dates.mp4

18:18

8. Applying aggregation.mp4

09:33

9. Spark Windowing Functions.mp4

25:03

10. Pivoting in Spark.mp4

06:27

11. Passing List of columns to Dataframe.mp4

06:45

12.1 department.csv

12.2 employees.csv

12. Joins in Spark.mp4

29:04

13. Use case - Bank Transaction Data.mp4

29:14

14. Reading Current days file.mp4

09:07

15.1 dml.zip

15.2 input.zip

15. Working with Fixed Width File.mp4

30:26

16. [Notes] Working with Fixed Width File.html

12. Productionalizing your Code

1. How does your code run in Production.mp4

04:53

2. Deploy in prod - parameterizing the filenames.mp4

35:06

3.1 application.zip

3.2 application.zip

3.3 config-1.3.4 (1).zip

3. Parameterize using Config File.mp4

51:30

4. [Notes] Parameterize using Config File.html

5. Spark Hive Integration.mp4

06:39

6. Memory Tuning in Spark.mp4

07:20

13. Complex Data Processing

1.1 file.zip

1. Working with Json.mp4

16:15

2.1 file1.zip

2.2 file2.zip

2. Working with MultiLine Json.mp4

05:19

3.1 address.zip

3. Working with Nested Json.mp4

10:17

4.1 cake.zip

4. Working with Nested Json - Struct and Array.mp4

20:29

5. Reading Json from a web URL and flattening it.mp4

10:18

6. [Notes] Reading Json from a web URL and flattening it.html

7. Flattening data by creating a Function.mp4

27:21

8. [Notes] Flattening data by creating a Function.html

9.1 address_flat.zip

9.2 address.zip

9. Complex Data Generation.mp4

09:15

10.1 product.zip

10. Flatten XML File.mp4

13:43

14. NOSQL Databases

1. What is a NOSQL Database.mp4

09:12

2. Working with HBase.mp4

34:01

3. [Notes] Working with HBase.html

4.1 hbase-client-1.1.2.2.6.2.0-205 (1).zip

4.2 hbase-common-1.1.2.2.6.2.0-205 (1).zip

4.3 hbase-protocol-1.1.2.2.6.2.0-205 (1).zip

4.4 hbase-server-1.1.2.2.6.2.0-205 (1).zip

4.5 shc-core-1.1.1-2.1-s_2.11 (1).zip

4. Spark HBase Integration.mp4

37:52

5. [Notes] Spark HBase Integration.html

6. Cassandra Introduction.mp4

05:03

7. Cassandra setup and working with Cassandra.mp4

20:59

8.1 apache-cassandra-3.11.13-bin.tar.zip

8.2 datastax-community-64bit_2.2.3.zip

8. [Notes] Cassandra setup and working with Cassandra.html

9. Cassandra Spark Integration.mp4

13:46

10.1 jsr166e-1.1.0 (1).zip

10.2 spark-cassandra-connector_2.11-2.3.1 (1).zip

10. [Notes] Cassandra Spark Integration.html

11. Cassandra Query Limitations.mp4

03:21

15. Apache NIFI

1. Apache NIFI Introduction.mp4

06:18

2. Apache NIFI Installation.mp4

07:20

3. [Notes] Apache NIFI Installation.html

4. Lets work with Apache NIFI Tool.mp4

14:19

5. Streaming from a web URL.mp4

10:27

6. Back Pressure and Connection Queue.mp4

06:02

7. Promoting to Another Environment.mp4

06:00

16. Working with Streaming Data

1. Spark DStream.mp4

17:01

2. Kafka Introduction.mp4

07:44

3. kafka installation and topic creation.mp4

18:37

4. [Notes] kafka installation and topic creation.html

5. Kafka NIFI Integration.mp4

06:17

6. How Kafka Works.mp4

11:49

7. Spark Kafka Integration.mp4

17:48

8.1 kafka-clients-0.10.0.1.zip

8.2 lz4-1.3.0.zip

8.3 scala-library-2.11.8.zip

8.4 slf4j-api-1.7.21.zip

8.5 snappy-java-1.1.2.6.zip

8.6 spark-sql-kafka-0-10_2.11-2.3.0.zip

8.7 spark-streaming-kafka-0-10_2.11-2.3.0.zip

8.8 spark-tags_2.11-2.3.0.zip

8.9 unused-1.0.0.zip

8. [Notes] Spark Kafka Integration.html

9. Using Kafka Offset Explorer tool.mp4

14:22

10. Kafka Delivery Guarantee Feature.mp4

05:02

11.1 file1.zip

11.2 file2.zip

11.3 file3.zip

11.4 file4.zip

11.5 file5.zip

11. Spark Structured Streaming.mp4

13:29

12. [Notes] Spark Structured Streaming.html

13. Spark Kafka Integration.mp4

11:37

14. [Notes] Spark Kafka Integration.html

17. Extra

1. Performance Tuning Tips.mp4

05:34

Description

Become big Data Engineer with skills like Hadoop, Sqoop, Hive, Spark, Scala, Cassandra, HBase, NIFI, Kafka and much more

What You'll Learn?

Understand the architecture of Hadoop
Understand file formats and the ability to choose the right format for a given use case
Develop applications on local system and then deploy them into production
Parameterize the code and make it production ready
Import data from mysql database into sqoop. Export data from hdfs to mysql. Get a deep understanding of sqoop
Query and analyze the data effectively using Hive. Get a strong understanding of hive
Learn Scala - one of the top programming languages
Learn basic, intermediate and Advance concepts of Spark which is very hot in the market
Work with complex data and learn how to process them effectively
Learn Cassandra and integrate it with Spark
Learn HBase and integrate it with Spark
Learn Apache NIFI
Work with Spark Streaming - Learn about Kafka and how it integrates with Spark
Get a good understanding of end to end big data pipeline

Who is this for?

Beginners who are completely new to Big Data world

Software Engineers who want to shift to Big Data or upgrade their Big Data skills

Managers , Data Analytics want to understand the end to end big data pipeline

More details

Description
There is huge demand for Big Data Developers right now and it is only going to increase with increase in Data. Sometimes it can be very overwhelming with the amount to skillset that is required to be a Big Data Developer/ Big Data Engineer. Through this course we will help you in obtaining all those skills and make you job ready.Â This course is developed by the Big Data experts. It is structured in a way to make you comfortable and ease out any nervousness you may have. We warm you with the basics and then start increasing the complexity. This is 90 percent hands on.Â There will be lot of use cases and lot of hands-on. This is tailor made for a developer.Â We will cover everything from local development to deploying in production, troubleshooting and performance improvement. This has close to 33 hours of Video Tutorials, all explained with examples. We have a team to address any questions you may have in this course.
Here is a short description of what you will be learning in this course:
Understand the world of Big Data. What is Big data and why it is important
Understand and learn the concepts behind Hadoop. Understand its architecture
Install the softwares and start writing code
Learn important Hadoop Commands
Learn the file formats and understand when to use each of the file formats
Dive deep into Sqoop- a tool used for transferring data between RDBMSÂ and HDFS
Dive deep into Hive- a tool used for querying the data on HDFS
Learn Scala -Â a top programming language
Dive deep into Spark which is very hot in the market
Learn NOSQLÂ Databases - Cassandra and HBase and integrate them with Spark
Work with Complex data and process them effectively
Make your code production ready and deploy them onto the cluster
Learn Apache NIFI- a powerful and scalable open source tool for data routing
Work with Streaming data
Learn Kafka and integrate it with Spark
Learn troubleshooting techniques and performance improvement tips
This is complete end-to-end implementation course and we are very proud to bring this course to you.Â
Enroll now and join the world of Big Data !
Who this course is for:
Beginners who are completely new to Big Data world
Software Engineers who want to shift to Big Data or upgrade their Big Data skills
Managers , Data Analytics want to understand the end to end big data pipeline

User Reviews

Rating

average 0

Total votes0

Focused display

Big Data

Deesa Technologies

Instructor's Courses

We are a small team of passionate and experienced software Engineers whose goal is to provide you with the best training that is possible by inculcating best practices followed, by adding our experience on the subject and making the course as easy as possible. We have successfully taught thousands of students online and are here to share our experience with you. We believe in quality of the course and so any feedback on improving the course content will be worked on passionately. We are also available to guide you and answer any questions you may have. Please post them on the F and Q section or message us using the conversation tool on Udemy.Happy Learning !!

Udemy

View courses Udemy

Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.