Azure Synapse SQL Account

In this article

Overview

You can use this account type to connect Azure Synapse SQL Snaps with data sources that use Azure Synapse SQL account.

Azure Synapse SQL Account.png

Prerequisites

None.

Limitations

The Azure Synapse Analytics does not support Batch Insert and, therefore, does not honor Batch executions.

Known Issues

None.

Account Settings

 

  • Asterisk ( * ): Indicates a mandatory field.

  • Suggestion icon (): Indicates a list that is dynamically populated based on the configuration.

  • Expression icon (): Indicates whether the value is an expression (if enabled) or a static value (if disabled). Learn more about Using Expressions in SnapLogic.

  • Add icon (): Indicates that you can add fields in the field set.

  • Remove icon (): Indicates that you can remove fields from the field set.

Field Name

Field Type

Field Dependency

Description

Field Name

Field Type

Field Dependency

Description

Label*

Default Value: None.
Example: Azure Synapse SQL Account

String

N/A

Specify a unique label for the account.

 

Account properties*

Use this field set to define the account properties.

Hostname*

Default Value: N/A
Example: sl-synapse.sql.azuresynapse.net

String/Expression

N/A

Specify the server's address to which you must connect.

Port number*

Default Value: N/A
Example: 1433

Integer/Expression

N/A

Specify the port number of the database server to which you must connect.

Database name*

Default Value: N/A
Example: Synapse SQL

String/Expression

N/A

 Specify the name of the database to which you must connect.

Username

Default Value: N/A
Example: snapadminuser

String/Expression

N/A

Specify the username to connect to the database.
This username is used as the default username when retrieving connections and must be valid to set up the data source.

Password

Default Value: N/A
Example: P#2,nxu0oiX2&?

String/Expression

N/A

Specify the password used to connect to the data source.
This password is used as the default password when retrieving connections and must be valid to set up the data source.

JDBC JARs

Use this field set to specify the JDBC JAR files to be loaded.  Add each JAR file in a separate row.

JDBC driver

Default Value: N/A
Example: mssql-jdbc-11.2.0.jre11.jar

String

N/A

Specify the driver to use for your application. By default, the latest JDBC driver 12.2.0.jre11 is bundled with the Azure Synapse SQL Account. However, you can manually upload a custom JAR file.

JBDC driver class*

Default Value: com.microsoft.sqlserver.jdbc.SQLServerDriver
Example: com.microsoft.sqlserver.jdbc.SQLServerDriver

String

N/A

Specify the fully qualified name of the driver class to be used for connecting to the server.

 

Trust all certificates

Default Value: Deselected
Example: Selected

Checkbox

N/A

Select this checkbox if all SSL certificates are to be accepted for connecting to the database.

External location

Default Value: None
Example: Blob Storage

Dropdown list

N/A

Select one of the following source data locations from which to load data into the target database:

  • None: Data is not staged on an external location.

  • Blob Storage: Data is stored in Azure Blob Storage.

  • Azure Data Lake Gen2: Data is stored in ADLS.

External storage endpoint

Default Value: N/A
Example: 
blob.core.windows.net (for Blob Storage)
dfs.core.windows.net (for ADLS Gen2)

String/Expression

Appears on selecting Blob Storage or Azure Data Lake Gen2 for External location.

Specify the endpoint path for the selected external location. 

 

 

Storage Account

Default Value: N/A
Example: snapdev

String/Expression

Appears on selecting Blob Storage or Azure Data Lake Gen2 for External location.

Specify your account name to access the selected Azure external storage location.  

Azure container

Default Value: N/A
Example: snapdev

String/Expression

Appears on selecting Blob Storage or Azure Data Lake Gen2 for External location.

Specify the name of the container in the Azure storage account.

 

Azure folder

Default Value: N/A
Example: dev

String/Expression

Appears on selecting Blob Storage or Azure Data Lake Gen2 for External location.

Specify the relative path for the folder within the container specified above. Leave this field blank to use all the folders in the specified container.

Azure auth type

Default Value: Access Key
Example: Shared Access Signature

Dropdown list

Appears on selecting Blob Storage or Azure Data Lake Gen2 for External location.

Select the authentication type to use for accessing the external storage location. Then, provide the values for Azure Identify and Azure Secret fields or the selected authentication type. The available options are:

  • Access Key

  • Shared Access Signature

  • Managed Identity

Learn more about authentication types: COPY INTO (Transact-SQL)  in Microsoft Docs.

Storage key

Default Value: N/A
Example: 9PHrnM97QUmS/6JKXgQvceDk75vr/9dtHR+AStvw==

String/Expression

Appears on selecting Managed Identity for Azure auth type.

Specify the storage access key of the Azure Storage Account.

Azure identity

Default Value: N/A
Example: Storage Account Key

String/Expression

Appears on selecting Blob Storage or Azure Data Lake Gen2 for External location.

Specify the Azure Identity to access the selected external storage location.

  • If the Azure Auth Type is:

    • Access Key, then the Azure Identity must be a constant with a value of Storage Account Key.

    • Shared Access Signature, then the Azure Identity must be a constant with a value of Shared Access Signature.

    • Managed Identity, then the Azure Identity must be a constant with a value of Managed Identity.

The minimum RBAC roles required are Storage blob data contributor or Storage blob data owner for the AAD registered SQL Database server.

Azure secret

Default Value: N/A
Example: UvhVF65Bukk9hVF65BuUvhVF

String/Expression

Appears on selecting Blob Storage or Azure Data Lake Gen2 for External location.

Specify the Azure Secret corresponding to the selected authentication type. 

  • If the Azure Auth Type is:

    • Shared Access Signature, then the Azure Secret must be the Shared Access Signature that provides delegated access to resources in your storage account.
      Minimum permissions required are READ and LIST.

    • Access Key, then the Azure Secret must be the Storage Account Key value.

Learn more about the expected values for this field.: COPY INTO (Transact-SQL) in Microsoft Docs. 

Enable error file support

Default Value: Deselected

Checkbox

N/A

Select this checkbox to specify the directory within the COPY statement where the rejected rows and the corresponding error file should be written.

The error file only applies to CSV file formats.

Error file Azure folder

String/Expression

Appears when you select Error file Azure folder.

Specify a valid path to a folder in the Azure container. You can specify the full path from the storage account or specify the path relative to the container.

Use new Azure account for error file

Default Value: Deselected

Checkbox

Appears when you select Error file Azure folder.

Select this checkbox if you need to configure a new account.
Deselect this checkbox if the error file is in the same Azure storage account as configured.

Error file external location


Default Value: Blob Storage
Example: Azure Data Lake Gen2

Dropdown list

Appears when you select Use new Azure account for error file.

Choose either of the following external locations where the files containing the data is staged:

  • Blob Storage

  • Azure Data Lake Gen2

External storage endpoint

Default Value: N/A
Example:

  • blob.core.windows.net

  • dfs.core.windows.net

String/Expression

Appears when you select Use new Azure account for error file.

Specify the endpoint in your external location path.

Error file storage account

Default Value: N/A
Example: snaps_strg_account

String/Expression

Appears when you select Use new Azure account for error file.

Specify a valid Azure Storage Account.

Error f ile Azure container

Default Value: N/A
Example: snaps_container

String/Expression

Appears when you select Use new Azure account for error file.

Specify a valid Azure Container to use for staging data.

Error file Azure auth type

Default Value: Access Key
Example: Managed Identity

Dropdown list

Appears when you select Use new Azure account for error file.

Choose the athorization type to access the error file in Azure Synapse:

  • Access Key

  • Shared Access Signature

  • Managed Identity

Error File Azure identity

Default Value: N/A
Example: <Encrypted>

String/Expression

Appears when you select Use new Azure account for error file.

Specify the Azure Identity that is part of the credential that specifies the authentication mechanism to access the external storage account.

Error file Azure secret

Default Value: N/A
Example: <Encrypted>

String/Expression

Appears when you select Use new Azure account for error file.

Secret is part of the credential that specifies the authentication mechanism to access the external storage account.

Advanced properties

 Use this field set to specify the advanced properties.

Auto commit

Default value: Selected

Checkbox/Expression

N/A

Select this checkbox to commit each batch immediately after it is executed. If the Snap fails, only the batch being executed at that moment gets rolled back.

Deselect this checkbox to commit the execution output only after the execution of all batches is complete. If the Snap fails, the entire transaction is rolled back, unless the Snap finds invalid input data before it sends the insert request to the server and routes the error documents to the Error view.

Batch size*

Default Value: 50
Example: 60

Integer/Expression

 N/A

Specify the number of statements to execute at a time.

Fetch size*

Default Value: 100
Example: 80

Integer/Expression

N/A

Specify the number of rows to fetch at a time when executing a query.

Max pool size*

Default Value: 50
Example: 60

Integer/Expression

N/A

Specify the maximum number of connections a pool must maintain at a time.

 

Max lifetime (minutes)*

Default Value: 30
Example: 50

Integer/Expression

N/A

Specify the maximum lifetime (in minutes) of a connection in the pool.

Idle timeout (minutes)*

Default Value: 5
Example: 8

Integer/Expression

N/A

Specify the maximum amount of time (in minutes) a connection is allowed to sit idle in the pool.

A value of 0 indicates that idle connections are never removed from the pool.

Checkout timeout (milliseconds)*

Default Value: 10000
Example: 1000

Integer/Expression

N/A

Specify the timeout (in milliseconds) to wait for a connection to be available when the pool is exhausted.

URL properties

Use this field set to define URL properties to use if any.

URL property name

Default Value: N/A
Example: MAX_CONCURRENCY_LEVEL

String/Expression

N/A

Specify a name for the URL property if any.

URL property value

Default Value: N/A
Example: 3

 

String/Expression

N/A

Specify a value for the URL property name.

Snap Pack History

 


Related Content