Overview

You must create Databricks accounts to connect to Databricks Snaps in your Pipelines with the source or target CDWs (databases). This account enables you to write-and-transform data in the target databases hosted in the cloud locations listed in the following table. The JDBC URL you configure for your target database indicates the respective cloud location where the database is hosted. You can configure your Databricks accounts in SnapLogic using either the Designer or the Manager.

Known Issues

With the basic authentication type for Databricks Lakehouse Platform (DLP) reaching its end of life on July 10, 2024, SnapLogic Databricks pipelines designed to use this authentication type to connect to DLP instances would cease to succeed. We recommend that you reconfigure the corresponding Snap accounts to use the Personal access tokens (PAT) authentication type.

Supported JDBC JAR Version

You can configure your Databricks Account to automatically use the recommended JDBC JAR file - databricks-jdbc-2.6.25-1.jar for connecting to your target DLP instance and performing the load and transform operations. 

Snap-Account Compatibility

Snaps in the Databricks Snap Pack work with the different accounts and protocols in the following table:

^# Source type is required in

Configuring Databricks Accounts Using SnapLogic Designer

Open the SnapLogic Designer and drag a Databricks Snap to the Canvas and click the Snap to open its settings. Click the Account tab. You can now either use an existing account or create a new one.

Selecting an existing account

SnapLogic organizes and displays all accounts to which you have access, sorting them by account type and location. To select an existing account:

1. In the Account tab, click the List   icon to view the accounts to which you have access, and select the account that you want to use. 
   

2. Click the Save icon.
   

   Image Modified

Creating an account

1. In the Account tab, click Add Account below the Account Reference field.
   

2. Select the Location in which you want to create the account, select the Account Type, and click Continue. The Add Account dialog window associated with the account type appears, as shown:

   Image Modified

3. Enter the required account details. Learn more about how to provide the information required for each account type in the following articles:

   • Databricks Account (Source: ADLS Gen2)

   • Databricks Account (Source: ADLS Blob Storage)

   • Databricks Account (Source: AWS S3)

   • Databricks Account (Source: Google Cloud Storage)

   • Databricks Account using JDBC (Source: Any SQL Database)

4. Click Validate to verify the account, if the account type supports validation.

5. Click Apply to complete configuring the Databricks account.

Configuring Databricks Accounts Using SnapLogic Manager

You can use Manager to create accounts without associating them immediately with Pipelines.

1. In the left pane, browse to the project in which you want to create the account and click  Create > Account > Databricks, followed by the appropriate account type. The Create Account dialog associated with the selected account type appears, as shown:
   

   Image Modified

2. Repeat steps 3 through 5 in the Creating an account section.

Snap Pack History

Related Links

• Accounts in SnapLogic

• Databricks Snap Pack