Skip to end of banner
Go to start of banner

Azure Synapse SQL Entra Account

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 24 Next »

In this article

Overview

You can use this account type to connect Azure Synapse SQL Snaps with data sources that use Azure Synapse SQL Entra account.

Prerequisites

None.

Limitations and Known Issues

None.

Account Settings

  • Asterisk ( * ): Indicates a mandatory field.

  • Suggestion icon ( (blue star) ): Indicates a list that is dynamically populated based on the configuration.

  • Expression icon ( (blue star) ): Indicates whether the value is an expression (if enabled) or a static value (if disabled). Learn more about Using Expressions in SnapLogic.

  • Add icon ( (blue star) ): Indicates that you can add fields in the field set.

  • Remove icon ( (blue star) ): Indicates that you can remove fields from the field set.

Field Name

Field Type

Field Dependency

Description

Label*

Default Value: N/A
ExampleAzure Synapse SQL Active Directory Account

String

N/A

Specify a unique label for the account.

Account properties*

Hostname*

Default Value: N/A
Example: snpqazzuresynapse.sql.azuresynapse.net

String/Expression

N/A

Specify the server's address to which you need to connect.

Port Number*


Default Value: N/A
Example: 1433

Integer

N/A

Specify the port number of the database server to which you need to connect.

Database name*


Default Value: N/A
Example: snapsdb

String/Expression

N/A

 Specify the name of the database to which you need to connect.

Username


Default Value: N/A
Example: snapadmin@sl.onmicrosoft.com

String/Expression

N/A

Specify the username that is allowed to connect to the database.
This username is used as the default username when retrieving connections and must be valid to set up the data source.

Password


Default Value: N/A
Example: P#2,nxu0oiX2&?

String/Expression

N/A

Specify the password used to connect to the data source.
This password is used as the default password when retrieving connections and must be valid to set up the data source.

JDBC JARs

Use this field set to specify the JDBC JAR files to be loaded.  Add each JAR file in a separate row.

JDBC Driver

Default Value: N/A
Example: mssql-jdbc-11.2.0.jre11.jar

String

N/A

Specify the driver to use for your application. By default, the latest JDBC driver 12.2.0.jre11 is bundled with the Azure Synapse SQL Account. However, you can manually upload a custom JAR file.

JBDC Driver Class*

Default Value: com.microsoft.sqlserver.jdbc.SQLServerDriver
Example: com.microsoft.sqlserver.jdbc.SQLServerDriver

String

N/A

Specify the fully qualified name of the driver class to be used for connecting to the server.

 

Trust all certificates

Default ValueDeselected

Checkbox

N/A

Select this checkbox if all SSL certificates are to be accepted for connecting to the database.

External Location


Default Value: None
Example: Blob Storage

Dropdown list

N/A

Select one of the following options to set the external location for staging data:

  • None: Data is not staged on an external location.

  • Blob Storage: Data is stored in Azure Blob Storage.

  • Azure Data Lake Gen2: Data is stored in ADLS.

External Storage Endpoint

Default Value: N/A
Example: 
blob.core.windows.net (for Blob Storage)
dfs.core.windows.net (for ADLS Gen2)


String/Expression

Appears on selecting Blob Storage or Azure Data Lake Gen2 for External Location.

Specify the endpoint path for the selected external location. 

Storage Account


Default Value: N/A
Example: adlsgen2v02

String/Expression

Appears on selecting Blob Storage or Azure Data Lake Gen2 for External Location.

Specify your Account name to access the selected Azure external storage location. 

Azure Container


Default Value: N/A
Example: hrdepartment

String/Expression

Appears on selecting Blob Storage or Azure Data Lake Gen2 for External Location.

Specify the name of the container in the Azure storage account.

Azure Folder


Default Value: N/A
Examplesalaries

String/Expression

Appears on selecting Blob Storage or Azure Data Lake Gen2 for External Location.

Specify the relative path for the folder within the container specified above. Leave this field blank to use all the folders in the specified container.

Azure Auth Type


Default Value: Access Key
Example: Shared Access Signature

Dropdown list

Appears on selecting Blob Storage or Azure Data Lake Gen2 for External Location.

Select the authentication type to use for accessing the selected Azure external storage location. Then, provide the values for Azure Identify and Azure Secret fields or the selected authentication type. Available options are:

  • Access Key

  • Shared Access Signature

  • Managed Identity

Learn more about authentication types: COPY INTO (Transact-SQL)  in Microsoft Docs.

Azure Identity


Default Value: N/A
Example: Storage Account Key

String/Expression

Appears on selecting Blob Storage or Azure Data Lake Gen2 for External Location.

Specify the Azure Identity to access the selected external storage location.

  • If the Azure Auth Type is:

    • Access Key, then the Azure Identity must be a constant with a value of Storage Account Key.

    • Shared Access Signature, then the Azure Identity must be a constant with a value of Shared Access Signature.

    • Managed Identity, then the Azure Identity must be a constant with a value of Managed Identity.

The minimum RBAC roles required are Storage blob data contributor or Storage blob data owner for the AAD registered SQL Database server.

Azure Secret


Default Value: N/A
Example: UvhVF65Bukk9hVF65BuUvhVF

String/Expression

Appears on selecting Blob Storage or Azure Data Lake Gen2 for External Location.

Specify the Azure Secret corresponding to the selected authentication type. 

  • If the Azure Auth Type is:

    • Shared Access Signature, then the Azure Secret must be the Shared Access Signature that provides delegated access to resources in your storage account.
      Minimum permissions required are READ and LIST.

    • Access Key, then the Azure Secret must be the Storage Account Key value.

Learn more about the expected values for this field.: COPY INTO (Transact-SQL) in Microsoft Docs.

Enable Error File Support

Default Value: Deselected

Checkbox

N/A

Select this checkbox to specify the directory within the COPY statement where the rejected rows and the corresponding error file should be written.

The error file only applies to CSV file formats.

Error File Azure Folder

String/Expression

Appears when you select Error File Azure Folder.

Specify a valid path to a folder in the Azure container. You can specify the full path from the storage.

Use new Azure account for error file

Default Value: Deselected

Checkbox

Appears when you select Error File Azure Folder.

Select this checkbox if you need to configure a new account.
Deselect this checkbox if the error file is in the same Azure storage account as configured.

Error File External Location

Default Value: Blob Storage
Example: Azure Data Lake Gen2

String/Expression

Appears when you select Use new Azure account for error file.

Choose either of the following external locations where the files containing the data is staged:

  • Blob Storage

  • Azure Data

External Storage Endpoint

Default Value: N/A
Example:

  • blob.core.windows.net

  • dfs.core.windows.net

String/Expression

Appears when you select Use new Azure account for error file.

Specify the endpoint in your external location path.

Error File Storage Account

Default Value: N/A
Example: snaps_strg_account

String/Expression

Appears when you select Use new Azure account for error file.

Specify a valid Azure

Error File Azure Container

Default Value: N/A
Example: snaps_container

String/Expression

Appears when you select Use new Azure account for error file.

Specify a valid Azure Container to use for staging data.

Error File Azure Auth Type

Default Value: Access Key
Example: Managed Identity

String/Expression

Appears when you select Use new Azure account for error file.

Choose the athorization type to access the error file in Azure Synapse:

  • Access Key

  • Shared Access Signature

  • Managed Identity

Error File Azure Identity

Default Value: N/A
Example: <Encrypted>

String/Expression

Appears when you select Use new Azure account for error file.

Specify the Azure Identity that is part of the credential that specifies the authentication mechanism to access the external storage account.

Error File Azure Secret

Default Value: N/A
Example: <Encrypted>

String/Expression

Appears when you select Use new Azure account for error file.

Secret is part of the credential that specifies the authentication mechanism to access the external storage account

Advanced properties

Auto commit


Default ValueSelected

Checkbox

N/A

Select this checkbox to commit each batch immediately after it is executed. If the Snap fails, only the batch being executed at that moment is rolled back.

Deselect this checkbox to commit the execution output only after the execution of all batches is complete. If the Snap fails, the entire transaction is rolled back, unless the Snap finds invalid input data before it sends the insert request to the server, and routes the error documents to the Error view.

Batch size*

Default Value: 50
Example: 60

Integer

N/A

Specify the number of statements to execute at a time.

  • Select queries are not batched.

  • Using a large batch size could use up the JDBC placeholder limit of 2100.

Fetch size*


Default Value: 100
Example: 80

Integer

N/A

Specify the number of rows to fetch at a time when executing a query.
Large values could cause the server to run out of memory.

Max pool size*


Default Value: 50
Example: 60

Integer

N/A

Specify the maximum number of connections a pool must maintain at a time.

Max life time*


Default Value: 30
Example: 50

Integer

N/A

Specify the maximum lifetime (in minutes) of a connection in the pool.

Ensure that the value you enter is a few seconds shorter than any database or infrastructure-imposed connection time limit. A value of 0 indicates an infinite lifetime, subject to the Idle Timeout value. An in-use connection is never retired. Connections are removed only after they are closed.

Idle Timeout*


Default Value: 5
Example: 8

Integer

N/A

Specify the maximum time period (in minutes) a connection is allowed to sit idle in the pool.

A value of 0 indicates that idle connections are never removed from the pool.

Checkout timeout*


Default Value: 10000
Example: 8000

Integer

N/A

Specify the timeout (in milliseconds) to wait for a connection to be available when the pool is exhausted.

A value of zero waits infinitely—an exception is thrown after the wait time has expired.

URL properties

Use this field set to define additonal URL properties to use if any.

URL Property Name

String

N/A

Specify a name for the URL property if any.

URL Property Value

String

N/A

Specify a value for the URL property name.

Snap Pack History

 Click here to expand...

Release

Snap Pack Version

Date

Type

Updates

August 2024

main27765

Stable

Upgraded the org.json.json library from v20090211 to v20240303, which is fully backward compatible.

May 2024

437patches26597

Latest

Fixed an issue with the Azure Synapse SQL Select Snap that displayed an error and did not retry the connection when the serverless SQL pool was warming up.

May 2024

main26341

Stable

February 2024

436patches25597

-

Upgraded the jOOQ library of the Azure Synapse SQL Snap Pack from v3.9.1 to v3.17.x.

This upgrade is currently NOT available with the latest distribution. However, you can still consume this patch through 436patches25597. This update is scheduled to be included in the latest distribution release on April 10, 2024, and will be a part of the stable distribution with the GA release on May 8. 2024.

Behavior change:

The jOOQ library upgrade for Azure Synapse SQL Snap Pack, done as part of the 436patches25597, resulted in the following behavior change:

Previously, when “null”(string) was passed from the upstream Mapper Snap for the Bigint datatype, the /wiki/spaces/DRWIP/pages/3011674578Snap updated it as null without displaying any error. It displayed the status as 0 and the output message as Success. Now, the Snap displays the following error in this scenario:

Error converting value(expecting a number but you are sending String(“null”))

If you pass null from Mapper Snap with the expression enabled, the Snap updates the null value for the BigInt datatype correctly, as earlier.

February 2024

main25112

Stable

Updated and certified against the current SnapLogic Platform release.

November 2023

main23721

Stable

Updated and certified against the current SnapLogic Platform release.

August 2023

main22460

Stable

The Azure Synapse SQL - Execute Snap now includes a new Query type field. When Auto is selected, the Snap tries to determine the query type automatically.

May 2023

433patches21718

Latest

Fixed an issue with the Azure Synapse SQL Bulkload Snap that caused a 404 error when the External Location was set to ADLS Gen2 and the Azure Folder field was not specified in the account settings.

May 2023

main21015

Stable

Upgraded with the latest SnapLogic Platform release.

February 2023

432patches20389

Latest

The Azure Synapse SQL Account and Azure Synapse SQL Active Directory Account now support the latest JDBC Driver 12.2.0.jre11 by default. You do not have to upload the JAR file in the JDBC Driver field manually.

February 2023

main19844

 

Stable

Upgraded with the latest SnapLogic Platform release.

November 2022

431patches19493

Latest

The Azure Synapse SQL - Bulk Load Snap no longer fails when loading the JDBC driver from SLDB as it now uses the uploaded JAR driver when performing all bulk load operations.

November 2022

431patches19410

Stable

Fixed the Azure SQL - Execute Snap using the Azure SQL Active Directory Account that failed with SQL operation failed errors in environments using federated authentication

November 2022

431patches19410

Latest

Fixed the Azure SQL - Execute Snap using the Azure SQL Active Directory Account that failed with SQL operation failed errors in environments using federated authentication

November 2022

431patches19354

Latest

The Azure Synapse SQL - Bulk Load Snap no longer fails with the error Invalid column value in CSV data file when the data contains the field quote character (").

November 2022

431patches19263

Latest

The Azure Synapse SQL Insert Snap no longer supports the Preserve Case Sensitivity checkbox.

November 2022

main18944

Stable

Introduced the Azure Synapse SQL Snap Pack. The Azure Synapse Analytics is service from Microsoft that helps you query data to create, update, insert, or delete data in the Azure Synapse SQL. This Snap Pack contains the following Snaps:


Related Content

  • No labels