End-to-End Real-World Data Engineering Project with Databricks

Focused View

Deepak Goyal

1:40:36

0 View

01 - Introduction

01 - Project kickoff Data engineering with Databricks.mp4

00:45

02 - What you should know.mp4

01:03

02 - 1. Databricks Real-World Project Details

01 - Databricks case study Overview.mp4

05:49

02 - Data lakehouse High-level solution.mp4

04:06

03 - Databricks project architecture diagram.mp4

03:07

03 - 2. Databricks Project Setup

01 - Databricks account creation.mp4

01:50

02 - Initial folder creation.mp4

03:32

03 - Loading the sample data.mp4

02:20

04 - 3. Databricks Bronze Layer Implementation

01 - Create the Bronze layer database.mp4

04:55

02 - Create a Databricks notebook to load a CSV file to the customer delta table.mp4

13:59

03 - Create a Databricks notebook to load a JSON file to the product delta table.mp4

05:42

04 - Create a Databricks notebook to load a Parquet file to the order delta table.mp4

08:04

05 - 4. Databricks Silver Layer Implementation

01 - Create the Silver layer database.mp4

01:08

02 - Create a Databricks notebook to load the Silver layer Customer delta table.mp4

15:19

03 - Create a Databricks notebook to load the Silver layer Product delta table.mp4

08:39

04 - Create a Databricks notebook to load the Silver layer Order delta table.mp4

06:01

06 - 5. Databricks Gold Layer Implementation

01 - Create the Gold layer database.mp4

01:12

02 - Create a Databricks notebook to load the Gold table Part 1.mp4

02:18

03 - Create a Databricks notebook to load the Gold table Part 2.mp4

02:11

07 - 6. Databricks and Power BI Data Visualization

01 - Install Power BI Desktop.mp4

01:32

02 - Integrate Databricks and Power BI.mp4

04:31

03 - Create the Power BI dashboard from Databricks.mp4

01:37

08 - Conclusion

01 - Next steps.mp4

00:56

Description

This comprehensive course offers a practical, hands-on approach to building a modern data pipeline using Databricks. Join instructor Deepak Goyal as he guides you through a real-world data engineering project that transforms a data lake into an efficient, analytics-ready solution using the Databricks ecosystem. Learn how an end-to-end project works in Databricks, how to implement the three-layer medallion architecture—bronze, silver, and gold—and how to use Spark SQL in a real-world data project. Ideal for professional data engineers as well as data analysts, this course can help you take your technical skills to the next level and put you in a more in-demand position to land the data role of your dreams.

More details

User Reviews

Rating

average 0

Total votes0

Focused display

Data Science

Deepak Goyal

Instructor's Courses

Linkedin Learning

View courses Linkedin Learning

LinkedIn Learning is an American online learning provider. It provides video courses taught by industry experts in software, creative, and business skills. It is a subsidiary of LinkedIn. All the courses on LinkedIn fall into four categories: Business, Creative, Technology and Certifications. It was founded in 1995 by Lynda Weinman as Lynda.com before being acquired by LinkedIn in 2015. Microsoft acquired LinkedIn in December 2016.