Monitoring and Optimizing Queries in Databricks SQL

Focused View

Kishan Iyer

1:54:18

94 View

1. Course Overview

1. Course Overview.mp4

02:05

02. Monitoring and Administering Queries

01. Course Prerequisites and Outline.mp4

01:56

02. An Overview of Databricks SQL.mp4

02:16

03. The Need to Monitor Queries.mp4

05:37

04. Demo - Setting up a Databricks Workspace.mp4

02:56

05. Demo - Adding a User to a Databricks Workspace.mp4

04:23

06. Demo - Creating Databricks SQL Queries.mp4

04:35

07. Demo - Granting Access to SQL Queries.mp4

03:37

08. Demo - Granting Access to Databases.mp4

05:47

09. Demo - Regulating Access to Tables.mp4

03:07

10. Demo - Tracking Query Executions.mp4

06:56

11. Demo - Monitoring SQL Endpoint Usage.mp4

02:41

03. Optimizing Query Executions

01. Delta Lakes.mp4

06:18

02. Optimizing Delta Tables.mp4

04:20

03. Demo - Viewing Details of Delta Tables.mp4

05:07

04. Demo - Restoring a Delta Table.mp4

04:00

05. Query Caching in Databricks.mp4

02:50

06. Demo - Delta Cache Accelerated Nodes.mp4

02:22

07. Demo - Using Delta Caches.mp4

05:03

08. Demo - Querying Data from a Delta Cache.mp4

01:48

09. Demo - Creating a Spark Cache.mp4

04:42

10. Demo - Testing the Effects of Spark Caching.mp4

03:20

4. Creating and Configuring Query Alerts

1. Encrypting Queries.mp4

02:21

2. Demo - Configuring a Key Vault for a Databricks Workspace.mp4

05:02

3. Demo - Linking a Custom Encryption Key with Databricks.mp4

04:33

4. Query Alerts.mp4

02:00

5. Demo - Setting a Query to Run on a Schedule.mp4

04:31

6. Demo - Defining a Query Alert.mp4

03:37

7. Demo - Testing an Alert.mp4

05:27

8. Course Summary and Related Content.mp4

01:01

Description

This course will teach you to monitor query executions in Databricks SQL, and also regulate access to query objects. You will learn how to optimize query executions with caches, encrypt queries, and configure alerts based on query results.

What You'll Learn?

Queries lie at the heart of Databricks SQL and managing them correctly will ensure that we make the best use of this platform. In this course, Monitoring and Optimizing Queries in Databricks SQL, you will learn various aspects of query management, from basic administration to encryption, with a special emphasis on query monitoring and optimization. First, you will explore how to create a Delta table and queries which run against it. Next, you will discover how query execution times can be reduced by two different caching mechanisms supported by Databricks SQL - Delta caching and Spark caching. Finally, you will learn how we can monitor the results of query executions and trigger an alert when those results fulfill a specific condition. At the end of this course, you will be well-versed with various aspects of query management, which will help you ensure that your queries are configured correctly, that they run in an optimal manner, and that you are alerted the moment their results point to something that is off.

More details

User Reviews

Rating

average 0

Total votes0

Focused display

Microsoft SQL

Kishan Iyer

Instructor's Courses

I have a Masters in Computer Science from Columbia University and have worked previously as a developer and DevOps engineer. I now work at Loonycorn which is a studio for high-quality video content. My interests lie in the broad categories of Big Data, ML and Cloud.

Pluralsight

View courses Pluralsight

Pluralsight, LLC is an American privately held online education company that offers a variety of video training courses for software developers, IT administrators, and creative professionals through its website. Founded in 2004 by Aaron Skonnard, Keith Brown, Fritz Onion, and Bill Williams, the company has its headquarters in Farmington, Utah. As of July 2018, it uses more than 1,400 subject-matter experts as authors, and offers more than 7,000 courses in its catalog. Since first moving its courses online in 2007, the company has expanded, developing a full enterprise platform, and adding skills assessment modules.