CI/CD in Azure Databricks using Azure DevOps

Focused View

Mr. K Talks Tech

2:03:50

8 View

1. Introduction- What is CICD.mp4

09:27

2. Environment Setup- Azure Databricks and Azure DevOps.mp4

28:24

3. Continuous Integration (CI) Pipeline.mp4

20:14

4.1 cicd-pipelines.zip

4.2 databrickstoken.zip

4.3 deploy-notebooks.zip

4. YAML code for CI Pipeline.mp4

27:09

5. Setting up the CI Pipeline.mp4

11:36

6. Creating the Continuous Deployment (CD) Pipeline.mp4

17:56

7. End to End CICD Pipeline Testing.mp4

09:04

Description

Databricks and Azure DevOps- Master CI/CD deployment across two environments with ease in this straightforward course.

What You'll Learn?

Build CI/CD Pipelines using Azure DevOps
Azure Databricks CI/CD Process
Understanding YAML code
Data Integration
Get Familiar with Azure Concepts
Infrastructure and Security

Who is this for?

This course is for absolute beginners who is looking to become an Azure Data Engineer and DevOps Engineer.

What You Need to Know?

Basic Programming skills

More details

Description
In this Course, Firstly, I have discussed about what is CI/CD, how we will be using it for deploying Azure Databricks notebook from dev to prod and the merging techniques that we are going to follow for building the CI/CD pipelines.
Then, I have discussed about the different environment setup required for building the CI/CD pipelines. Things like Integrating the Azure DevOps with Azure Databricks workspace, Branch protection and merging techniques are seen in this video with Demo. I have also discussed about the process of the Continuous Integration (CI) pipeline and created the setup required for creating the CI pipelines. Then, I have discussed about the process of the Continuous Integration (CI) pipeline and explained the different YAML code used for creating the pipeline and followed by the actual creation of the CI/CD pipeline using the YAMl file.
After creating the CI part, I have discussed about the Continuous Deployment part where it deploys changes from DEV to PROD databricks workspace.
Finally, I have discussed about how to setup permissions for the PROD environment before deploying the changes in PROD and also the complete end to end CI/CD pipeline testing. I Hope you learn more in this course.

#cicd #azuredevops #devops #databricks #azuredatabricks
Who this course is for:
This course is for absolute beginners who is looking to become an Azure Data Engineer and DevOps Engineer.

User Reviews

Rating

average 0

Total votes0

Focused display

Mr. K is a passionate teacher created this channel for only one goal "TO HELP PEOPLE LEARN THE MODERN DATA PLATFORM SOLUTIONS USING CLOUD TECHNOLOGIES" I will be creating playlist which covers the below topics (with DEMO) 1. Azure Beginner Tutorials 2. Azure Data Factory 3. Azure Synapse Analytics 4. Azure Databricks 5. Microsoft Power BI 6. Azure Data Lake Gen2 7. Azure DevOps 8. GitHub (and several other topics) Can't wait to help people with my videos. Stay tuned!

Udemy

View courses Udemy

Students take courses primarily to improve job-related skills.Some courses generate credit toward technical certification. Udemy has made a special effort to attract corporate trainers seeking to create coursework for employees of their company.