Microsoft Fabric Data Engineering Mastery: A Complete Guide

Focused View

Kris Wenzel

7:53:29

0 View

1 - Introduction

1 - Introduction to Microsoft Fabric Data Engineering.mp4

02:44

2 - Course Resources for Dataflow SQL and Python.txt

2 - How to take this Course.mp4

06:07

3 - Introduction to Microsoft Fabric.mp4

06:35

3 - Intro-to-MS-Fabric.pdf

3 - Wilsonmargitbubio Reference for some Images I used Nice Blog Article.txt

4 - Car Sales Case Study and Fabric Technology Stacks.mp4

07:11

4 - Intro-to-MS-Fabric-Case-Studies.pdf

5 - Introduction to Microsoft Fabric Data Engineering and Certification Alignment.html

2 - Medallion Architecture and Data Modeling

6 - Introduction to Medallion Architecture.mp4

03:47

6 - Medallion-Architecture-Introduction.pdf

7 - Medallion Architecture Data Layers Explained.mp4

10:12

7 - Medallion-Architecture-Layers.pdf

8 - Data Model Overview.mp4

07:59

8 - Medallion-Architecture-Data-Modeling.pdf

3 - Setting up Microsoft Fabric

9 - Create a Free Microsoft Fabric Account.mp4

01:52

9 - Microsoft Fabric Getting Started.txt

10 - Microsoft Fabric Home Page.txt

10 - Setup Your First Microsoft Fabric Workspace.mp4

02:40

11 - Car Prices from the Kaggle Vehicle Sales Dataset.txt

11 - Setup Raw Lakehouse.mp4

08:54

11 - car-prices.csv.zip

4 - Data Engineering with Dataflow Gen2

12 - Course Resources for Dataflow SQL and Python.txt

12 - To Bronze Using Dataflow Gen2 to Ingest Data.mp4

10:07

12 - To-Bronze.pdf

13 - To Silver Intro to Ingesting Data to Silver Layer.mp4

02:24

13 - To-Silver.pdf

14 - To Silver Using Dataflow Gen2 to Ingest Data part 1.mp4

09:29

15 - To Silver Using Dataflow Gen2 to Ingest Data part 2.mp4

21:20

16 - To Silver Addressing Dataflow Gen2 Refresh Issue.mp4

07:02

17 - To Gold Intro to Ingesting Data to Gold Layer.mp4

08:38

17 - To-Gold.pdf

18 - To Gold Addressing Fix to Silver Layer Data.mp4

01:36

19 - To Gold Preparing Dimensions using Dataflow Gen2 part 1.mp4

10:58

20 - To Gold Preparing Dimensions using Dataflow Gen2 part 2.mp4

20:00

21 - To Gold Preparing CarSales Fact Table using Dataflow Gen2.mp4

22:50

22 - Visualization Dataflow Gen 2 Semantic Model.mp4

08:39

23 - Visualization Using PowerBI to Visualize Data.mp4

11:39

24 - Visualization Dataflow Gen 2 Data Fixes.mp4

14:54

25 - Pipelines Automating Data Engineering from Raw to Gold Layer.mp4

07:43

5 - Data Engineering with SQL

26 - Course Resources for Dataflow SQL and Python.txt

26 - Introduction.pdf

26 - Introduction to Data Engineering with SQL.mp4

02:20

27 - Course Resources for Dataflow SQL and Python.txt

27 - SQL Workspace Setup.mp4

06:07

28 - Course Resources for Dataflow SQL and Python.txt

28 - To Bronze Data Pipeline Copy Activity.mp4

08:56

29 - SQL-To-Silver.pdf

29 - To Silver Intro to Ingesting Data in the Silver Layer.mp4

02:11

30 - To Silver Writing Silver Layer Queries part 1.mp4

13:35

31 - To Silver Writing Silver Layer Queries part 2.mp4

11:41

32 - To Silver Writing Silver Layer Queries part 3.mp4

14:25

33 - Azure Data Studio.txt

33 - To Silver Using Azure Data Studio alongside MS Fabric.mp4

04:51

34 - To Gold Intro to Ingesting Data in the Gold Layer.mp4

04:20

35 - To Gold Dimension Modeling using SQL part 1.mp4

12:36

36 - To Gold Dimension Modeling using SQL part 2.mp4

20:51

37 - To Gold Dimension Modeling using SQL part 3.mp4

18:18

38 - To Gold Creating Pipeline for Automation.mp4

11:08

39 - To Gold Data Visualization of SQL Prepared Gold Layer.mp4

09:19

6 - Using PySpark and Python for Microsoft Fabric Data Engineering

40 - Course resources for Dataflow SQL and Python.txt

40 - Introduction.mp4

01:54

40 - Introduction.pdf

41 - Course resources for Dataflow SQL and Python.txt

41 - Setting up PySpark Workspace in Microsoft Fabric.mp4

04:32

42 - Course resources from Dataflow SQL and Python.txt

42 - To Bronze Using Python and PySpark to Ingest Data.mp4

16:49

43 - To Silver Preparing Silver Layer using PySpark and Python part 1.mp4

11:15

44 - To Silver Preparing Silver Layer using PySpark and Python part 2.mp4

10:52

45 - To Silver Preparing Silver Layer using PySpark and Python part 3.mp4

11:08

46 - PySpark-To-Gold.pdf

46 - To Gold Dimension Modeling using PySpark and Python part 1.mp4

03:29

47 - To Gold Dimension Modeling using PySpark and Python part 2.mp4

12:58

48 - To Gold Dimension Modeling using PySpark and Python part 3.mp4

10:14

49 - To Gold CarSales Fact table preparation using PySpark and Python.mp4

12:34

50 - To Gold Running Notebooks via Pipelines.mp4

07:38

51 - To Gold Preparing Semantic Layer.mp4

03:49

52 - To Gold Visualizing Data using PowerBI Reports.mp4

10:19

Description

Hands-On Learning with Azure Data Factory, Spark & Medallion Architecture for Scalable Data Solutions

What You'll Learn?

Optimize Microsoft Fabric: Learn best practices for efficient data engineering organization.
Understand Azure Data Factory: Grasp workflow orchestration for foundational knowledge in data engineering.
Apply Data Integration: Utilize principles for end-to-end solutions in comprehensive data engineering.
Evaluate Data Transformations: Compare techniques within Microsoft Fabric for informed data processing.
Implement Solutions with Azure Data Factory: Leverage it with SQL Data Warehouse for comprehensive data engineering.
Develop Solutions with Spark: Create end-to-end solutions for large-scale data processing and analytics.
Construct Fabric Data Flows: Tailor flows in Microsoft Fabric for transforming and managing data in Lakehouse.
Build Fabric Spark Jobs: Create advanced Spark jobs within Microsoft Fabric for complex data transformations.
Establish Data Warehouse: Ingest from Fabric Lakehouse for a scalable and reliable data warehouse.
Design ADF Pipelines: Develop Azure Data Factory pipelines for efficient end-to-end data transformations.
Create Data Solutions with Dataflows: Construct end-to-end solutions, integrating components for seamless data processing.
Apply DevOps for Version Control: Utilize Microsoft DevOps for systematic source code management.
Implement Medallion Architecture: Apply advanced principles in Microsoft Fabric for efficient data handling.

Who is this for?

Data Engineers: Professionals responsible for designing, constructing, and maintaining data architecture, databases, and processing systems.

Data Analysts: Individuals seeking to expand their data processing and integration skills for comprehensive data analysis.

Database Administrators: Those looking to enhance their knowledge of Microsoft Fabric and related tools for optimizing data management.

Business Intelligence Professionals: Individuals interested in developing end-to-end solutions for business intelligence and analytics.

Data Scientists: Professionals aiming to strengthen their data engineering capabilities, especially in large-scale data processing using technologies like Spark.

IT Professionals: Those involved in IT roles looking to specialize in data engineering within the Microsoft ecosystem.

Students and Graduates: Individuals pursuing education or recently graduated in fields related to data science, computer science, or information technology.

Technology Enthusiasts: Individuals with a keen interest in learning about the latest tools and best practices in the field of data engineering.

Professionals Transitioning Careers: Individuals seeking a career change into the field of data engineering or related roles.

Anyone Interested in Microsoft Data Technologies: Enthusiasts looking to gain expertise in Microsoft technologies for data engineering and analytics.

What You Need to Know?

Familiarity with SQL and basic programming skills can be beneficial. We'll focus on SQL and Python. I provide to you all the sample you need to complete the case study.

Proficiency in programming will be valuable when working with scripting and data transformation tasks

Experience in troubleshooting and debugging technical issues will aid in building and troubleshooting Azure Data Factory pipelines.

Note: A Credit or Debit card may be required for you to set up your free Azure Account.

More details

Description
Unlock the potential of data engineering with Microsoft Fabric in this comprehensive, hands-on course. Designed for data engineers, analysts, and IT professionals, this course provides practical skills to build scalable, robust data solutions. Through real-world exercises and a detailed case study, youâ€™ll master data transformation, integration, and pipeline automation with Microsoft Fabricâ€™s latest technologies.
What Youâ€™ll Learn:
Introduction to Microsoft Fabric: Begin with an overview of Microsoft Fabricâ€™s core features, workspace setup, and data ingestion processes to lay a strong foundation.
Medallion Architecture Mastery: Learn to implement the Medallion Architecture by organizing data into Raw, Bronze, Silver, and Gold layers for efficient and scalable processing.
Dataflows Gen 2 for Transformation: Explore Dataflows Gen 2 to manage data across stages, from Raw to Gold, while troubleshooting common issues for seamless ingestion.
Advanced SQL and Python Integration: Use SQL and Python for data processing, automation, and transformation. Build powerful pipelines, automate workflows, and leverage PySpark for enhanced data management.
Visualization and Reporting: Gain insights into using PowerBI to visualize data, design interactive dashboards, and create comprehensive reports tailored for decision-making.
End-to-End Data Engineering Solutions: Construct complete data engineering workflows using Dataflows, pipelines, and transformation techniques to build scalable architectures.
Practical Application with Car Sales Case Study: Follow a real-world case study to reinforce concepts, applying each tool and technique to solve practical problems.
Course Highlights:
Hands-On Learning: Participate in guided exercises to work alongside the instructor, implementing real data engineering solutions from scratch.
Flexible Learning Path: Advance at your own pace, beginning with foundational skills and moving to complex data processing with SQL, Python, and Spark.
Interactive Exercises and Real-World Scenarios: Build and optimize dataflows, pipelines, and data models to solve common data engineering challenges.
Direct Instructor Support and Community Engagement: Access expert guidance and connect with a community of learners to share insights and troubleshoot issues.
Who Should Enroll:
Data Engineers and Analysts looking to deepen their expertise in Microsoft Fabric and data processing.
Database Administrators wanting to streamline data management with Microsoft Fabric.
Business Intelligence Professionals eager to create end-to-end solutions for analytics.
Data Scientists expanding their data engineering capabilities for large-scale data.
IT Professionals and Tech Enthusiasts interested in Microsoftâ€™s cutting-edge data engineering tools.
Take your data engineering skills to new heights with Microsoft Fabric. Join us for hands-on experience and a practical approach to building scalable data solutions!

Note:Â This course is a good introduction to Fabric and covers many of the topics required for the Azure Data Engineer Associate certification.Â Check out the preview lesson "Introduction to Microsoft Fabric Data Engineering and Certification Alignment" to see what's covered and what is not.
Who this course is for:
Data Engineers: Professionals responsible for designing, constructing, and maintaining data architecture, databases, and processing systems.
Data Analysts: Individuals seeking to expand their data processing and integration skills for comprehensive data analysis.
Database Administrators: Those looking to enhance their knowledge of Microsoft Fabric and related tools for optimizing data management.
Business Intelligence Professionals: Individuals interested in developing end-to-end solutions for business intelligence and analytics.
Data Scientists: Professionals aiming to strengthen their data engineering capabilities, especially in large-scale data processing using technologies like Spark.
IT Professionals: Those involved in IT roles looking to specialize in data engineering within the Microsoft ecosystem.
Students and Graduates: Individuals pursuing education or recently graduated in fields related to data science, computer science, or information technology.
Technology Enthusiasts: Individuals with a keen interest in learning about the latest tools and best practices in the field of data engineering.
Professionals Transitioning Careers: Individuals seeking a career change into the field of data engineering or related roles.
Anyone Interested in Microsoft Data Technologies: Enthusiasts looking to gain expertise in Microsoft technologies for data engineering and analytics.

User Reviews

Rating

average 0

Total votes0

Focused display

Azure DevOps

Kris Wenzel

Instructor's Courses

If you're interested in learning SQL, you're in the right place.I'm here to help you build a strong foundation in all aspects of SQL: from the very first steps to complex data architectures and designs. Many people struggle with where to begin learning SQL, but you don’t have to!! Essential SQL is my platform for bringing all aspects of SQL to you.With more than 30 years of experience in SQL and a degree in Computer Engineering from the University of Michigan, I am passionate about helping others learn this valuable skill. As a blogger, I share SQL tips and how-to articles with over a million readers each year on my blog, Essential SQL. In addition, I have been teaching online for over eight years to people from various industries, including accounting, purchasing, and human resources.In my professional life, I work with large corporations to design data warehouses that support business intelligence and data science activities. I believe that SQL is a valuable skill that is within reach for anyone, and my courses are designed to help you learn and grow with the technology.So, what will you get out of my courses?You will learn SQL from the ground up and progress to advanced concepts. Whether you are a beginner with no prior experience in SQL or looking to expand your knowledge and skills, these courses are tailored to meet your needs.One of the key features of my courses is the hands-on experience and exercises that I provide. Instead of just talking about concepts and theories, I believe that the best way to learn is by doing. That's why my courses are packed with practical exercises that allow you to apply what they have learned and see the results for yourself.As you work through my courses, I will be with you every step of the way to provide guidance and support. I will walk you through the very basics of SQL, such as selecting data from tables and filtering results, and then progress to more advanced topics like creating and modifying tables, working with data types, and using built-in functions. By the end of the course, you will have a solid understanding of SQL and be able to apply what you have learned to real-world situations.In short, my Essential SQL courses offer a comprehensive and practical learning experience that will take you from the very basics to advanced concepts in SQL. Whether you are looking to improve your career prospects, solve problems more efficiently, or just want to learn more about this powerful language, my courses have you covered.What are Students Saying?For the lessons I have covered so far, the instructor is doing a great job in explaining key concepts of stored procedure with several examples of SQL statements to refine business logic. Pretty cool -- Billandre O.Teaching style is really practical. It takes a depth of topical understanding to reduce the topic to an accessible form. He’s got those skillz – Mathew CI like the way Kris teaches delicate subjects in simple English. This course helps students and beginners to better understand Database Design and Data Modeling. I highly recommend it to start your journey in the relational database world. – Radouane BSo far this course teach me in a very short of time how to get confidence with Stored Procedures. I need to learn the subject quick for a job interview . But it's not only basic staff. The lecture gave important example and teach us to use it in the most advantage way for SQL. – Yael M.Excellent course with clear explanations. The instructor had an easy and likeable approach that comprehensively answered how to wield the power of the subquery. Highly recommended. – Andre MSo what are you waiting for? Enroll in one of my courses today.See you in class.Kris

Udemy

View courses Udemy

Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.