Configure a Databricks Destination
  • 09 May 2024
  • 1 Minute to read
  • Dark
    Light
  • PDF

Configure a Databricks Destination

  • Dark
    Light
  • PDF

Article Summary

This article will describe how to configure Bobsled to grant access to data transfers made to Databricks. The data will be delivered to the Bobsled-managed destination and access will be authorized to the provided Databricks account or Open Delta Sharing recipient. 

Prerequisites

Before configuring a destination, a share must be created.

Bobsled requires that you provide the following information for the target Databricks workspace:  

  • Cloud
  • Region 

Bobsled supports two types of sharing with Databricks - Databricks-to-Databricks sharing andOpen Delta Sharing

Databricks-to-databricks sharing should be used when a consumer is able to accept a Databricks share. Most Databricks consumers can accept this type of sharing which leads to an easier setup process for you and a better consumption experience for the consumer. If the consumer uses Unity Catalog in Databricks, then they will be able to accept this type of share. To enable this share you'll need to get the consumers unique sharing identifier, also known as the metastore id. To learn more about how and where to find your sharing identifier, please visit: our simplified documentation here or see full Databricks documentation -  Request the recipient's sharing identifier.

Open Sharing uses the open Delta Sharing protocol to enable sharing data. If the consumer does not use Unity Catalog in Databricks, then they are only able to accept Open sharing shares.

Configuring the destination


1.
 Choose the cloud platform Databricks. Select the cloud platform and region where the target Databricks account is hosted. Press continue to move to step 2.

2a. Databricks-to-databricks sharing - Enter Databricks Metastore ID and click Grant Access. Select Finish to save. 

2b. Open Sharing - Provide a human readable name to identify your recipient. Next a link for your consumer to download credentials will be generated. You should send this link to the consumer to access the credentials. Credentials are only able to be downloaded once.  

    2.1. To revoke access, click Revoke.


Was this article helpful?