Data Engineering with Informatica, Snowflake and Streamlit

Focused View

Marcos Vinicius Oliveira

6:03:36

6 View

1. Introduction

1. Introduction to the course.mp4

02:11

2. Snowflake Setup

1.1 01 Source Data and Mapping Sheet.xlsx

1. Creating a Snowflake account.mp4

02:36

2. Loging into Snowflake.mp4

01:47

3. Creating Databases and Schemas.mp4

03:20

4. Creating course tables - 1.mp4

05:33

5. Creating course tables - 2.mp4

05:32

6. Creating course tables - 3.mp4

06:20

7.1 07 Source Data and Mapping Sheet.xlsx

7. Creating course tables - 4.mp4

04:55

3. IICS Setup

1. Creating an IICS Data Integration trial account.mp4

03:48

2. Installing the local secure agent.mp4

03:56

3. Creating a flat file connection.mp4

02:29

4. Creating a Snowflake connection.mp4

05:58

5.1 12 iicscourse.zip

5. Setting up a parameter file.mp4

03:32

4. SOS - Changing objects permissionownership on Snowflake

1. Updating objects ownership on Snowflake.mp4

04:27

5. IICS Data Ingestion

1.1 14 iicscourse.zip

1. Source files overview.mp4

02:36

2. STG Product Mapping.mp4

12:49

3. Issue on using mapping task instead of mass ingestion for loading files.mp4

01:51

4. STG Touchpoint Mapping.mp4

06:51

5. PSA Calendar.mp4

09:24

6. STG Media Spend.mp4

13:24

7. Data Review.mp4

03:18

6. IICS Delete + Insert

1. PSA Product Mapping.mp4

11:36

2. PSA Product Mapping.mp4

06:21

3. PSA Media Spend.mp4

09:39

7. DWH Logic

1. DWH mapping - 1.mp4

05:23

2. DWH mapping - 2.mp4

05:26

3. DWH mapping - 3.mp4

04:49

4. DWH mapping - 4.mp4

03:58

5. DWH mapping - 5.mp4

08:44

6. DWH mapping - 6.mp4

04:54

7. DWH mapping - 7.mp4

13:25

8. Snowflake Dashboard

1. Snowflake Dashboard Design - 1.mp4

04:37

2. Snowflake Dashboard Design - 2.mp4

05:15

3. Snowflake Dashboard Design - 3.mp4

02:38

4. Snowflake Dashboard Design - 4.mp4

07:05

5. Snowflake Dashboard Design - 5.mp4

03:45

6. Snowflake Dashboard Design - 6.mp4

05:19

7. Snowflake Dashboard Design - 7.mp4

10:00

9. Streamlit - Master Product App

1. Product Master app design - 1.mp4

01:33

2. Product Master app design - 2.mp4

05:14

3. Product Master app design - 3.mp4

05:35

4. Product Master app design - 4.mp4

06:06

5. Product Master app design - 5.mp4

08:37

6. Product Master app design - 6.mp4

07:49

7. Product Master app design - 7.mp4

10:48

8. Product Master app design - 8.mp4

11:13

9. Product Master app design - 9.mp4

08:55

10.1 47 st product app.zip

10. Product Master app design - 10.mp4

10:09

10. Streamlit - Mapping Apps

1. Product mapping app design - 1.mp4

10:14

2. Product mapping app design - 2.mp4

04:34

3. Product mapping app design - 3.mp4

12:45

4.1 51 st product mapping app.zip

4. Product mapping app design - 4.mp4

09:45

5. Touchpoint mapping app design - 1.mp4

12:09

6. Touchpoint mapping app design - 2.mp4

05:54

7.1 54 st touchpoint mapping app.zip

7. Touchpoint mapping app design - 3.mp4

05:42

11. Course Review

1. Historical load.mp4

03:34

2.1 56 iicscourse.zip

2. Course Review.mp4

03:29

Description

From source, through IICS, to Snowflake tables, dashboards and Streamlit apps in a single stack

What You'll Learn?

Setup Informatica Cloud, Snowflake and AWS Accounts
Design IICS Taskflows and assets
Ingest data from S3 to Snowflake with CDI
Build Snowflake Dashboards
Build Streamlit apps inside of Snowflake

Who is this for?

Data Engineers looking to get proficient on IICS using cloud platforms for data load/ingestion

Data Engineers looking to get into building Streamlit apps in Snowflake

What You Need to Know?

Basic knowledge on Informatica Cloud Data Integration (CDI)

Proficient knowledge on SQL and basic knowledge on Snowflake database

Basic knowledge on data modeling and engineering

Basic Python knowledge

More details

Description
Unlock the power of data integration and transformation with this comprehensive course designed to elevate your skills in handling data and leveraging Snowflake tables through Informatica Intelligent Cloud Services (IICS).
Throughout this course, you'll embark on a transformative journey, starting from the basics of extracting, transforming, and loading data (ETL) sourced from CSV files into Snowflake tables using IICS Data Integration. Delve deep into understanding the intricacies of data movement and manipulation, gaining proficiency in streamlining processes for seamless integration.
As the course progresses, you'll transition to exploring Snowflake's Dashboard capability, unlocking new avenues for data validation and analysis. Dive into creating visually appealing and insightful dashboards that provide a comprehensive overview of your data landscape, empowering you to make informed decisions with confidence.
But the learning doesn't stop there. We'll take it a step further by introducing you to Streamlit, a powerful tool for building interactive data applications with Python. Discover how to harness the capabilities of Streamlit to develop custom data apps that not only enhance the ETL process but also offer dynamic functionalities that can potentially replace certain steps altogether.
By the end of this course, you'll emerge equipped with a robust skill set in data integration, validation, and application development, ready to tackle real-world data challenges head-on. Whether you're a seasoned data professional or just starting your journey in the world of data engineering, this course provides invaluable insights and practical knowledge to propel your career forward.
Who this course is for:
Data Engineers looking to get proficient on IICS using cloud platforms for data load/ingestion
Data Engineers looking to get into building Streamlit apps in Snowflake

User Reviews

Rating

average 0

Total votes0

Focused display

Data Science

Marcos Vinicius Oliveira

Instructor's Courses

Senior Data Engineer with more than 12 years of experience with Data and Analytics, plus 4 years of experience with Snowflake and Snowflake - SnowPro Core Certified. Informatica Cloud Expert mainly on Data Integration and Mass Ingestion. Python Expert with focus on data analysis with pandas and data engineering scripts for production environments. Streamlit Expert on the Snowflake platform.

Udemy

View courses Udemy

Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.