Companies Home Search Profile

Working with Azure Databricks Programmatically

Focused View

Kishan Iyer

1:16:54

37 View
  • 01. Course Overview.mp4
    02:01
  • 02. Course Prerequisites and Outline.mp4
    02:15
  • 03. Interacting with Databricks.mp4
    04:35
  • 04. Automating Databricks Interactions.mp4
    06:06
  • 05. Demo.Downloading and Setting up the Databricks CLI.mp4
    07:41
  • 06. Demo.Viewing Cluster Data with the CLI.mp4
    06:05
  • 07. Demo.Deleting Clusters with the CLI.mp4
    03:36
  • 08. Demo.Creating and Editing Clusters.mp4
    06:17
  • 09. The Databricks REST Interface.mp4
    02:46
  • 10. Demo.Creating a Cluster with the Databricks REST API.mp4
    07:17
  • 11. Demo.Submitting REST Calls to Databricks from Python.mp4
    03:00
  • 12. Demo.Modifying and Deleting Clusters with the REST API.mp4
    03:33
  • 13. An Introduction to dbutils.mp4
    02:26
  • 14. Demo.Setting up Databricks Connect.mp4
    04:14
  • 15. Demo.Confuring Databricks Connect with a Workspace.mp4
    03:59
  • 16. Demo.Uploading a CSV File to DBFS.mp4
    03:31
  • 17. Demo.Performing File System Operations with dbutils.mp4
    06:19
  • 18. Course Summary and Related Content.mp4
    01:13
  • Description


    To carry out large-scale operations on Databricks, you'll need to develop apps or scripts which can interact with this big data service. This course looks into the Databricks CLI, its REST API, and the dbutils library to automate such interactions.

    What You'll Learn?


      While nearly every task in Databricks can be accomplished from its Web UI, to perform operations of any complexity at scale, you need to interact with this service from a script or an application. In this course, Working with Azure Databricks Programmatically, you'll learn about the Databricks command-line interface (CLI). First, you'll explore how we can create and use a personal access token for authentication, and how to construct CLI commands to perform a variety of workspace operations. Then, you'll explore the use of the Databricks REST API. Finally, you'll discover the versatility of the dbutils library in order to interact with the Databricks file system from a Python application. Once you complete this course, you'll have a clear understanding of how interactions with a Databricks service can be automated using the Databricks CLI, the REST API, and the dbutils package.

    More details


    User Reviews
    Rating
    0
    0
    0
    0
    0
    average 0
    Total votes0
    Focused display
    I have a Masters in Computer Science from Columbia University and have worked previously as a developer and DevOps engineer. I now work at Loonycorn which is a studio for high-quality video content. My interests lie in the broad categories of Big Data, ML and Cloud.
    Pluralsight, LLC is an American privately held online education company that offers a variety of video training courses for software developers, IT administrators, and creative professionals through its website. Founded in 2004 by Aaron Skonnard, Keith Brown, Fritz Onion, and Bill Williams, the company has its headquarters in Farmington, Utah. As of July 2018, it uses more than 1,400 subject-matter experts as authors, and offers more than 7,000 courses in its catalog. Since first moving its courses online in 2007, the company has expanded, developing a full enterprise platform, and adding skills assessment modules.
    • language english
    • Training sessions 18
    • duration 1:16:54
    • level average
    • Release Date 2023/12/15