Databricks

Overview

DataBricks develops a web-based platform for working with Spark, that provides automated cluster management and Python-style notebooks. It develops Delta Lake, an open-source project to bring reliability to data lakes for machine learning and other data science use cases.

Entitle can manage the following resource types in DataBricks:

• Jobs
• Workspaces
• Clusters

This page will provide you with instructions on how to integrate Entitle and DataBricks.

General guidelines

👉🏼 In order to integrate your DataBricks in Entitle, you will need to extract three items:

• Token
• URL
• Options

Set up DataBricks to work with Entitle

Stage 1: Extract a private token

1. Navigate to your Databricks tenant.
2. Once logged in with an Admin account, click on your user in the top right corner, and choose User Settings from the drop-down menu.

3. Click the Access Tokens tab.

4. Click the blue Generate new token button.

5. In the small window which opens up, fill in these two fields and click Generate:

   • Comment - a name for your token.
   • Lifetime (days) - for an indefinite token, don’t specify this field. However, take note that after the number of days you choose is up, the token will no longer be available to use in Entitle.

6. Make sure to copy your new token, as you will use it later in this guide.

Stage 2: Extract your URL

1. Copy the URL in your browser’s search box, you will use it later in this guide.
   

Stage 3: Choose your managed resource types

1. By default - if not specified, Entitle will fetch all managed resource types from your Databricks tenant - jobs, workspaces, and clusters.
2. You can narrow down the resource types managed by Entitle. The resource types are represented below:
   1. Jobs - will be represented as "jobs"
   2. Workspaces - will be represented as "workspaces"
   3. Clusters - will be represented as "clusters"

Creating the integration in Entitle

All that is left to do is create an integration on the Entitle application.

1. Log into Entitle and navigate to the Integrations page.
2. After clicking the Add Integration button, type DataBricks in the Application field.
3. Don’t forget to correctly set Save on on your agent or Entitle’s cloud.

4. In the configuration JSON, token field, paste your private token from Stage 1.
5. In the url field, paste your DataBricks URL from Stage 2, please make sure the https:// prefix is added as well.
6. In the options field, under resource types, add your chosen resource types given in Stage 3.
7. Example connection JSON:

{
    "token": "<YOUR_TOKEN>",
    "url": "<YOUR_URL>",
    "options": {
      "resources_types": [
        "jobs",
        "workspace",
        "clusters"
      ]
    }
}

8. Click Save, you are done!🎉