Page Comparison

Default Value: N/A

Example: ELT Account

Use this field set to configure the information required to establish a JDBC connection with the account.

This field set consists of the following fields:

• Database Type
• Download JDBC Driver Automatically
• JDBC JARs
• JDBC Driver Class
• JDBC URL
• Username
• Password
• Warehouse
• Default Database Name

Required. Select the target data warehouse into which the queries must be loaded. 

Available options are:

• Snowflake. Activates the Warehouse and Source Location fields.
• Redshift. Activates the Source Location field.
• Azure Synapse. Activates the following fields:
  • External Location
  • External Storage Endpoint
  • Storage Account
  • Azure Container
  • Azure Folder
  • Azure Auth Type
  • Azure Identity
  • Azure Secret
• Databricks Lakehouse Platform. See Spark settings required for supporting ELT on DLP. Activates the following fields:
  • Use Token Based Authentication
  • Username
  • Password
  • Token
  • Default Database Name
  • DBFS Folder path (source for loading Databricks table)

Default Value: N/A

Example: Snowflake

Default Value: Not Selected

Example: Selected

Default Value: N/A

Example: snowflake-jdbc-3.9.1.jar

Default Value: N/A

Example: net.snowflake.client.jdbc.SnowflakeDriver

Use Token Based Authentication

Select this checkbox to use token-based authentication for connecting to the target database (DLP) instance. Activates the Token field.

Default value: Selected

Example: Not selected

Enter the password for the username specified above.

Default value: N/A

Example: <Encrypted>

Enter the token value for accessing the target database / folder path.

Default value: N/A

Example: <Encrypted>

Enter the name of the Snowflake warehouse that you want to use.

Default value: N/A

Example: 12345abcdefghikj1km2345no

Enter the name of the database to use by default. This database is used if you do not specify one in the ELT Select, ELT Insert-Select, or ELT Merge Into Snaps. 

Default value: N/A

Example: EMPLOYEEDB

Default value: None

Example: S3, Azure, Google Cloud Storage

Enter the IAM role associated with the target Redshift cluster. See Create an IAM Role for details on creating and associating IAM Role with your Redshift cluster.

Default value: N/A

Example: myiamrole

Enter the access key ID associated with your AWS S3 account.

Default value: N/A

Example: ABCDEFGHIJKL1MNOPQRS

Enter the client secret key associated with your AWS S3 account.

Default value: N/A

Example: aBcdeFGhiJKLM/N1OPQRS/tUvWxyZABCDEFGHIJKLMN

Enter the SAS token part of the SAS URI associated with your Azure storage account. See Getting Started with SAS for details.

Default value: N/A

Example: ?sv=2020-08-05&st=2020-08-29T22%3A18%3A26Z&se=2020-08-30T02%3A23%3A26Z&sr=b&sp=rw&sip=198.1.2.60-198.1.2.70&spr=https&sig=A%1DEFGH1Ijk2Lm3noI3OlWTjEg2tYkboXr1P9ZUXDtkk%3D

Enter the access key ID associated with your AWS S3 account.

Default value: N/A

Example: ABCDEFGHIJKL1MNOPQRS

Enter the client secret key associated with your AWS S3 account.

Default value: N/A

Example: aBcdeFGhiJKLM/N1OPQRS/tUvWxyZABCDEFGHIJKLMN

Enter the session token value when the authorization to access the S3 folder is based on Security Token Service (STS) based temporary credentials.

Default value: N/A

Example: A%1DEFGH1Ijk2Lm3noI3OlWTjEg2tYkboXr1P9ZUXDtkk%3D

Enter the name of your Azure storage account.

Default value: N/A

Example: employeedata

Enter the name of the bucket from which to load the data.

Default value: N/A

Example: employeedata

Select the region of your Redshift cluster if it is different from the region of the S3 bucket. 

Available options are:

• Default
• us-east-1
• us-east-2
• us-west-1
• us-west-2
• af-south-1
• ap-east-1
• ap-south-1
• ap-northeast-1
• ap-northeast-2
• ap-northeast-3
• ap-southeast-1
• ap-southeast-2
• ca-central-1
• cn-north-1
• cn-northwest-1
• eu-central-1
• eu-west-1
• eu-west-2
• eu-west-3
• eu-south-1
• eu-north-1
• me-south-1
• sa-east-1

Default value: Default

Example: us-east-1, us-east-2

Enter the name of the folder in the S3 bucket specified above where the source files are located.

Default value: N/A

Example: hrdepartment

Select the source data location from which to load data into the target database. You must configure this field if you want to use the ELT Load Snap. 

Available options are:

• Blob Storage
• Azure Data Lake Gen2

Default value: Blob Storage

Example: Azure Data Lake Gen2

Enter the end point path for the selected external location. You must configure this field if you want to use the ELT Load Snap.

Default value: N/A

Example: .blob.core.windows.net (for Blob Storage), .dfs.core.windows.net (for ADLS Gen2)

Enter your Account name to access the selected Azure external storage location. You must configure this field if you want to use the ELT Load Snap.

Default value: N/A

Example: adlsgen2v02

Enter the name of the container in the Azure storage account.

Default value: N/A

Example: hrdepartment

Enter the relative path for the folder within the container specified above. Leave this field blank to use all the folders in the specified container. 

Enter the name of the GCS bucket from which to load the data to your Snowflake database.

Default value: N/A

Example: elt_gcs_bucket_1

Enter the name of the folder in the GCS bucket where the source files are located.

Default value: N/A

Example: elt_gcs_bucket_1_CSV_Files

Select the authentication type to use for accessing the selected Azure external storage location. Then, provide the values for Azure Identity, Azure Secret, Storage Key fields for the selected authentication type. See COPY INTO (Transact-SQL) in Microsoft Docs for more information on these authentication types.

Available options are:

• Storage Account Key
• Shared Access Signature
• Managed Identity
• <application_ID>@<OAuth_2.0_Token_EndPoint> (Service Principals)
• AAD User (Azure Active Directory User)

Default value: Storage Account Key

Example: AAD User

Enter the Azure Identity (the constant value) corresponding to the selected authentication type. See COPY INTO (Transact-SQL) in Microsoft Docs for more information on the suggested values for this field.

Default value: N/A

Example: Storage Account Key

Enter the Azure Secret corresponding to the selected authentication type. See COPY INTO (Transact-SQL) in Microsoft Docs for more information on the expected values for this field.

Default value: N/A

Example: UvhVF65Bukk9hVF65BuUvhVF

Enter the storage access key value corresponding to the Azure account mentioned in Storage Account field. See COPY INTO (Transact-SQL) in Microsoft Docs for more information on the expected values for this field.

Default value: N/A

Example: ufv!befDIuf#fnb$KH&_hweuf

Enter the Client ID of the application created in the Azure Active Directory portal -https://portal.azure.com.

Default value: N/A

Example: hewr42ap-32jd-pd95-ms38-b342bnasdh80

Enter the Client ID of the application created in the Azure Active Directory portal - https://portal.azure.com.

Default value: N/A

Example: jhweufv!befDIufwb*dsfwujfnb$KH&_

Other parameters that you want to specify as URL properties. See the following resources for a list of parameters that can be specified in this field set.

• Snowflake Account Parameters
• Snowflake Connection Parameters 
• Redshift - JDBC Driver Connection Parameters
• Azure Synapse - JDBC Driver Connection Parameters

This field set consists of the following fields:

• URL Properties
  • URL Property Name
  • URL Property Value