Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

In this article

Table of Contents
maxLevel2
absoluteUrltrue

Articles in this section

Panel
bgColor#ebf7e1
Child pages (Children Display)

Overview

You must create

<Snap Pack Name>

Databricks accounts to connect to

data sources that you want to use

Databricks Snaps in your Pipelines

. You

with the source or target CDWs (databases)This account enables you to write-and-transform data in the target databases hosted in the cloud locations listed in the following table. The JDBC URL you configure for your target database indicates the respective cloud location where the database is hosted. You can configure your

Slack

Databricks accounts in SnapLogic using either the Designer or the Manager.

Target Database

Supported Cloud Location

Cloud Location in JDBC URL

Databricks Lakehouse Platform (DLP)

AWS

jdbc:spark://<your_instance_code>.cloud.databricks.com or jdbc:databricks://<your_instance_code>.cloud.databricks.com

Microsoft Azure

jdbc:spark://<your_instance_code>.azuredatabricks.net or jdbc:databricks://<your_instance_code>.azuredatabricks.net

Limitations

  • With the basic authentication type for Databricks Lakehouse Platform (DLP) reaching its end of life on July 10, 2024, SnapLogic Databricks pipelines designed to use this authentication type to connect to DLP instances would cease to succeed. We recommend that you reconfigure the corresponding Snap accounts to use the Personal access tokens (PAT) authentication type.

Supported JDBC JAR Version

You can configure your Databricks Account to automatically use the recommended JDBC JAR file - databricks-jdbc-2.6.25-1.jar for connecting to your target DLP instance and performing the load and transform operations. 

Note

Using Alternate JDBC JAR File Versions

We recommend that you let the Snaps use the listed JAR file versions. However, you may choose a different JAR file version.

Snap-Account Compatibility

Snaps in the

<Snap

Databricks Snap Pack

Name> Snap Pack

work with the different accounts and protocols

per

in the following table

.

:

Snap

Account Type 1Account Type 2Protocols Supported

Configuring <Snap Pack Name> Accounts Using SnapLogic Designer

Drag a <Snap Pack Name>

Databricks Account (Source-wise)#

ADLS Gen2

ADLS Blob Storage

AWS S3

GCS

JDBC (Any database)

Databricks File System (DBFS)

Databricks - Select

Databricks - Insert

Databricks - Delete

Databricks - Bulk Load

Databricks - Merge Into

Databricks - Multi Execute

Databricks - Unload

# Source type is required in

Configuring Databricks Accounts Using SnapLogic Designer

Open the SnapLogic Designer and drag a Databricks Snap to the Canvas and click the Snap to open its settings. Click the Account tab. You can now either use an existing account or create a new one.

Selecting an existing account

SnapLogic organizes and displays all accounts to which you have access, sorting them by account type and location. To select an existing account:

  1. In the Account tab, click

the Image Removed icon
  1. the List (blue star)  icon to view the accounts to which you have access, and select the account that you want to use. 

  2. Click

Image Removed
  1. the Save (blue star) icon.

    Image Added

Creating an account

  1. In the Account tab, click Add Account below the Account Reference field.

  2. Select the Location in which you want to create the account, select the Account Type, and click ContinueThe Add Account dialog

window associated
  1. window associated with the account type appears

.
  1. , as shown:

    Image Added

  2. Enter the required account details.

For detailed guidance on
  1. Learn more about how to provide the information required for each account type

, see
  1. in the following articles:

Child pages (Children Display)
InfoEnter additional information on this account in the Notes field of the Info tab. This will help you–and other users–understand the purpose of the account, especially if there are multiple accounts of the same type. <Snap Pack Name>
  1. Databricks account.

Info
Configuring <Snap Pack Name>

You can choose the Source/Target Location as None to perform operations within the Databricks tables.

Configuring Databricks Accounts Using SnapLogic Manager

You can use Manager to create accounts without associating them immediately with Pipelines.

Note

Accounts in SnapLogic are associated with projects. You can use accounts created in other projects only if you have at least Read access to them.

  1. In the left pane, browse to the project in which you want to create the account and click

Plus_Account.pngImage Removed
  1.  Create > Account 

<Snap Pack Name>
  1. Databricks, followed by the appropriate account type.

 The 
  1.  The Create Account dialog associated with the selected account type appears

.
 
  1. , as shown:

    Image Added

  2. Repeat

the
  1. steps

numbered
  1. 3 through 5 in the Creating an account section.

Note

Avoid updating account credentials

while

when Pipelines using that account are executing. Doing so may lead to unexpected results, including your account getting locked.

Snap Pack History

Expand

Insert excerpt

XYZ

Databricks Snap Pack
Databricks Snap Pack
name

XYZ

Databricks Snap Pack History
nopaneltrue

See Also

Child pages (Children Display)