Deep-Dive in DeltaLake using PySpark in Databricks

Focused View

Sagar Prajapati

3:53:02

96 View

1 - Introduction and Syllabus.mp4

04:28

2 - Architecture and Introduction of DeltaLake.mp4

14:00

3 - How Delta table differs from Normal tables.mp4

13:48

4 - Create a Delta table.mp4

22:11

5 - Generate Column in Delta table.mp4

14:04

6 - Read a Delta table.mp4

04:28

7 - Write to a Delta table.mp4

09:05

8 - ReplaceWhere while writing to Delta table.mp4

10:33

9 - Delete a Delta table.mp4

06:16

10 - Update a Delta table.mp4

10:03

11 - Upsert or Merge Statment in Delta tables.mp4

21:08

12 - Understand transactional logs in deltalog folder.mp4

14:49

13 - How to go to time travel in Delta table using History.mp4

18:21

14 - Restore Delta table to previous version.mp4

06:37

15 - How to add constraint in Delta table.mp4

06:52

16 - How to add user meta data information in a Delta table.mp4

09:01

17 - Schema evolution and enforcement in Delta table.mp4

12:19

18 - Shallow and Deep Clone of Delta table.mp4

09:00

19 - Addition on Deep and Shallow Clone of Delta table.mp4

07:41

20 - How to enable Change Data Feed in Delta table.mp4

10:51

21 - Reduce small file issue using optimize.mp4

07:27

Description

Unlock the Power of Delta Lake: Master Databricks and Revolutionize Data Management in this Comprehensive Course

What You'll Learn?

Understand the power of Delta table in Apache Spark
Build Delta Lakehouse using Databricks
Explore advanced features of Delta Lake, such as schema evolution and time travel
Learn to use Databricks effectively for data processing and analysis
Understand End to End use of Delta tables in Apache Spark
Hands on practice with Delta Lake
Learn how to leverage the power of Delta Lake with a Spark Environment!

Who is this for?

Data Engineer who wants to switch to Azure Big Data Engineer

Beginner Apache Spark Developer

Data Analyst

What You Need to Know?

Basic Databricks and PySpark Knowlege needed

Must have experienced in SQL and Python

Willing to learn new skills

More details

Description
This is an immersive course that provides a comprehensive understanding of Delta Lake, a powerful open-source storage layer for big data processing, and how to leverage it using Databricks. With hands-on experience and a step-by-step approach, this course explores the core concepts, architecture, and best practices of Delta Lake. Throughout the course, you will gain valuable insights into data lakes, data ingestion, data management, and data quality. You will learn the advanced capabilities of Delta Lake, including schema evolution, transactional writes, asset management, and time travel. Moreover, this course covers how to integrate Delta Lake with Databricks, a cloud-based platform for data engineering and analytics. You will witness the seamless integration of Delta Lake with Databricks, empowering you to perform analytics, data engineering, and machine learning projects efficiently using these technologies. To enhance your learning experience, this course also includes an end-to-end project where you will apply the acquired knowledge to build a real-world data solution. You will design a data pipeline, perform data ingestion, transform data using Delta Lake, conduct analytics, and visualize the results. This hands-on project will solidify your understanding and provide you with practical skills applicable to various data-driven projects. By the end of this course, you will be equipped with the expertise to leverage the power of Delta Lake using Databricks and successfully implement scalable and reliable data solutions. Whether you are a data engineer, data scientist, or data analyst, this course offers immense value in advancing your big data skills and accelerating your career in the field of data engineering and analytics.
Who this course is for:
Data Engineer who wants to switch to Azure Big Data Engineer
Beginner Apache Spark Developer
Data Analyst

User Reviews

Rating

average 0

Total votes0

Focused display

I'm Sagar Prajapati and I have 4 years of industry experience. I teach more than 17,000 students on YouTube and have expertise in SQL, Python, PySpark, Databricks, ADF, Azure, and PowerBI. My students love the way I teach. Keep learning and enjoying. Check out my premium courses on my website(GeekCoders)

Udemy

View courses Udemy

Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.