Versions Compared

Old Version 33

changes.mady.by.user Sandhya Sriram

Saved on

compared with

New Version 34

changes.mady.by.user Sandhya Sriram

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

On this Page

Table of ContentsmaxLevel2absoluteUrltrueexcludeOlder Versions|Additional Resources|Related Links|Related

On this Page

Table of Contents
maxLevel2
absoluteUrltrue
excludeOlder Versions|Additional Resources|Related Links|Related Information

This account is used by the Snaps in the Azure SQL Snap Pack.

You can create an account from Designer or Manager. In Designer, when working on Pipelines, every Snap that needs an account prompts you to create a new account or use an existing account. The accounts can be created in or used from:

  • Your private project folder: This folder contains the Pipelines that will use the account.
  • Your Project Space’s shared folder: This folder is accessible to all the users that belong to the Project Space.
    • The global shared folder: This folder is accessible to all the users within an organization in the SnapLogic instance

    existing account. The accounts can be created in or used from:

    • Your private project folder: This folder contains the Pipelines that will use the account.
    • Your Project Space’s shared folder: This folder is accessible to all the users that belong to the Project Space.
    • The global shared folder: This folder is accessible to all the users within an organization in the SnapLogic instance.

    Limitations

    Selecting the Disable Connection Pooling checkbox forces the session state to close the existing connection and reopen another connection to the database for each Snap until the Pipeline is executed, which might affect the performance. Hence, we recommend that you select the Disable Connection Pooling checkbox only when there is clear isolation between Snap executions within a Pipeline.

    Account Configuration

    In Manager, you can navigate to the required folder and create an account in it (see Accounts). To create an account for binary files:

    1. Click Create, then select any Azure SQL Account:
      • Azure SQL Account
      • Azure SQL Dynamic Account

      • Azure SQL Active Directory Account

      • Azure SQL Active Directory Dynamic Account

    2. Supply an account label.
    3. Supply the account properties for your database.
    4. (Optional) Supply additional information on this account in the Notes field of the Info tab.
    5. Click Apply.
    Warning

    Avoid changing account credentials while Pipelines using them are in progress. This may lead to unexpected results, including locking the account.


    Note
    If the Snap fails to connect to the database, it will retry three more times. 

    You can Validate an account connection when creating a Azure SQL/Active Directory Account but not when creating a Azure SQL/Active Directory Dynamic Account because the account properties of a dynamic account are provided dynamically as Pipeline parameters.

    The difference between Azure SQL/Active Directory Account and Azure SQL/Active Directory Dynamic Account is that in the latter you can specify the Account properties as expressions referencing Pipeline parameters.


    Account Types

    Note

    Active Directory-based authentication is not supported in the Azure SQL Bulk Extract Snap.

    Azure SQL Account

    Expand
    titleAccount Settings


    Label

    		Required. User provided label for the account instance.

    Account properties

    		Required. Enter in the information to create a connection to the database.

    Hostname

    Required. The server's address to connect to.

    Default value: [None]

    Port Number

    Required. The database server's port to connect to.

    Default value: 3306

    Database name

    Required. The database name to connect to.

    Default value: [None]

    Username


    Username that is allowed to connect to the database. Username will be used as the default username when retrieving connections. The username must be valid in order to set up the data source.

    Default value: [None]

    Password


    Password used to connect to the data source. Password wil be used as the default password when retrieving connections. The password must be valid in order to set up the data source.

    Default value: [None]

    JDBC Jars

    List of JDBC Jar files to be loaded.

    Example: ../shared/sqljdbc4-2.0.jar

    JDBC Driver Class

    Required. JBDC driver class name to use.

    Default value: com.microsoft.sqlserver.jdbc.SQLServerDriver

    Trust all certificates

    Select if all SSL certificates are to be accepted for connecting to the database

    Default value: Not selected

    Azure storage account name

    		Required. Name with which Azure Storage was created. The Bulk Load Snap automatically appends the '.blob.core.windows.net' domain to the value of this property.

    Azure storage account key

    		Required. Key generated by Azure for this account.

    Azure storage container name

    		Required. Name of an existing container.
    Advanced properties

    Auto commit

    When selected, each of the batches is committed immediately after it is executed. If the Snap fails, only the batch being executed at that moment is rolled back.

    When deselected, the Snap execution output is committed only after all the batches are executed. If the Snap fails, the entire transaction is rolled back, unless the Snap finds invalid input data before it sends the insert request to the server, and routes the error documents to the Error view.

    Default value: Selected

    Disable connection pooling

    Select this checkbox to prevent the sharing of session state.


    Info
    Connection pooling keeps the connections active. When the Snap uses a connection and creates a table during execution, the table gets locked and is not released even after the Snap is executed and the connection is returned to the pool. If another Snap or the same Snap uses the same connection from the pool and reads the metadata of the same table, it displays an error that the resource is locked.

    We recommend you to select this checkbox for Snaps that use session state, for example, creating a temporary table.

    Default Value: Deselected

    Batch size

    Required. Number of statements to execute at a time.

    Note

    Select queries are not batched.


    Warning

    Using a large batch size could use up the JDBC placeholder limit of 2100.

    Default value: 50

    Fetch size

    Required. Number of rows to fetch at a time when executing a query.

    Warning

    Large values could cause the server to run out of memory.

    Default value: 100

    Max pool size

    Required. Maximum number of connections a pool will maintain at a time.

    Default value: 50

    Max life time

    Required. Maximum lifetime of a connection in the pool. Ensure that the value you enter is a few seconds shorter than any database or infrastructure-imposed connection time limit. A value of 0 indicates an infinite lifetime, subject to the Idle Timeout value. An in-use connection is never retired. Connections are removed only after they are closed.

    Default value: 30

    Idle Timeout

    Required. The maximum amount of time a connection is allowed to sit idle in the pool. A value of 0 indicates that idle connections are never removed from the pool.

    Default value: 5

    Checkout timeout

    Required. Number of milliseconds to wait for a connection to be available when the pool is exhausted. Zero waits forever. An exception will be thrown after the wait time has expired.

    Default value: 10000

    URL Properties

    URL property name

    URL property name

    Default value: [None]

    URL property value

    URL property value

    Default value: [None]

    Account Encryption

    Standard Encryption

    If you are using Standard Encryption, the High sensitivity settings under Enhanced Encryption are followed.


    Enhanced Encryption

    If you have the Enhanced Account Encryption feature, the following describes which fields are encrypted for each sensitivity level selected for this account.

    Account:

    • High: Password, Azure storage account key
    • Medium + High: Username, Password, Azure storage account key
    • Low + Medium + High: Hostname, Database name, Username, Password, Azure storage account key, Url property value


    Azure SQL Dynamic Account

    Expand
    titleAccount Settings

    With the Dynamic Account, you can specify the Account properties as expressions referencing Pipeline parameters.

    Account Settings

    Label

    		Required. User provided label for the account instance.

    Account properties

    		Required. Enter in the information to create a connection to the database.

    Hostname

    Required. The server's address to connect to.

    Default value: [None]

    Port Number

    Required. The database server's port to connect to.

    Default value: 3306

    Database name

    Required. The database name to connect to.

    Default value: [None]

    Username


    Username that is allowed to connect to the database. Username will be used as the default username when retrieving connections. The username must be valid in order to set up the data source.

    Default value: [None]

    Password


    Password used to connect to the data source. Password wil be used as the default password when retrieving connections. The password must be valid in order to set up the data source.

    Default value: [None]

    JDBC Jars

    List of JDBC Jar files to be loaded.

    Example: ../shared/sqljdbc4-2.0.jar

    JDBC Driver Class

    Required. JBDC driver class name to use.

    Default value: com.microsoft.sqlserver.jdbc.SQLServerDriver

    Trust all certificates

    Select if all SSL certificates are to be accepted for connecting to the database

    Default value: Not selected

    Azure storage account name

    		Required. Name with which Azure Storage was created. The Bulk Load Snap automatically appends the '.blob.core.windows.net' domain to the value of this property.

    Azure storage account key

    		Required. Key generated by Azure for this account.

    Azure storage container name

    		Required. Name of an existing container.
    Advanced properties

    Auto commit

    When selected, each of the batches is committed immediately after it is executed. If the Snap fails, only the batch being executed at that moment is rolled back.

    When deselected, the Snap execution output is committed only after all the batches are executed. If the Snap fails, the entire transaction is rolled back, unless the Snap finds invalid input data before it sends the insert request to the server, and routes the error documents to the Error view.

    Default value: Selected

    Batch size

    Required. Number of statements to execute at a time.

    Note

    Select queries are not batched.


    Warning

    Using a large batch size could use up the JDBC placeholder limit of 2100.

    Default value: 50

    Fetch size

    Required. Number of rows to fetch at a time when executing a query.

    Warning

    Large values could cause the server to run out of memory.

    Default value: 100

    Max pool size

    Required. Maximum number of connections a pool will maintain at a time.

    Default value: 50

    Max life time

    Required. Maximum lifetime of a connection in the pool. Ensure that the value you enter is a few seconds shorter than any database or infrastructure-imposed connection time limit. A value of 0 indicates an infinite lifetime, subject to the Idle Timeout value. An in-use connection is never retired. Connections are removed only after they are closed.

    Default value: 30

    Idle Timeout

    Required. The maximum amount of time a connection is allowed to sit idle in the pool. A value of 0 indicates that idle connections are never removed from the pool.

    Default value: 5

    Checkout timeout

    Required. Number of milliseconds to wait for a connection to be available when the pool is exhausted. Zero waits forever. An exception will be thrown after the wait time has expired.

    Default value: 10000

    URL Properties

    URL property name

    URL property name

    Default value: [None]

    URL property value

    URL property value

    Default value: [None]

    Account Encryption

    Standard Encryption

    If you are using Standard Encryption, the High sensitivity settings under Enhanced Encryption are followed.


    Enhanced Encryption

    If you have the Enhanced Account Encryption feature, the following describes which fields are encrypted for each sensitivity level selected for this account.

    Account:

    • High: Password, Azure storage account key
    • Medium + High: Username, Password, Azure storage account key
    • Low + Medium + High: Hostname, Database name, Username, Password, Azure storage account key, Url property value


    Azure SQL Active Directory Account

    Expand
    titleAccount Settings


    Label

    		Required. User provided label for the account instance.

    Account properties

    		Required. Enter in the information to create a connection to the database.

    Hostname

    Required. The server's address to connect to.

    Default value: [None]

    Port Number

    Required. The database server's port to connect to.

    Default value: 1433

    Database name

    Required. The database name to connect to.

    Default value: [None]

    Username

     

    Username that is allowed to connect to the database. Username will be used as the default username when retrieving connections. The username must be valid in order to set up the data source.

    Default value: [None]

    Password

     

    Password used to connect to the data source. Password wil be used as the default password when retrieving connections. The password must be valid in order to set up the data source.

    Default value: [None]

    Trust all certificates

    Select if all SSL certificates are to be accepted for connecting to the database

    Default value: Not selected

    Advanced properties 

    Auto commit

    When selected, each of the batches is committed immediately after it is executed. If the Snap fails, only the batch being executed at that moment is rolled back.

    When deselected, the Snap execution output is committed only after all the batches are executed. If the Snap fails, the entire transaction is rolled back, unless the Snap finds invalid input data before it sends the insert request to the server, and routes the error documents to the Error view.

    Default value: Selected

    Disable connection pooling

    Select this checkbox to prevent the sharing of session state.


    Info
    Connection pooling keeps the connections active. When the Snap uses a connection and creates a table during execution, the table gets locked and is not released even after the Snap is executed and the connection is returned to the pool. If another Snap or the same Snap uses the same connection from the pool and reads the metadata of the same table, it displays an error that the resource is locked.


    We recommend you to select this checkbox for Snaps that use session state, for example, creating a temporary table.

    Default Value: Deselected

    Batch size

    Required. Number of statements to execute at a time.

    Select queries are not batched.


    Using a large batch size could use up the JDBC placeholder limit of 2100.

    Default value: 50

    Fetch size

    Required. Number of rows to fetch at a time when executing a query.

    Large values could cause the server to run out of memory.

    Default value: 100

    Max pool size

    Required. Maximum number of connections a pool will maintain at a time.

    Default value: 50

    Max life time

    Required. Maximum lifetime of a connection in the pool. Ensure that the value you enter is a few seconds shorter than any database or infrastructure-imposed connection time limit. A value of 0 indicates an infinite lifetime, subject to the Idle Timeout value. An in-use connection is never retired. Connections are removed only after they are closed.

    Default value: 30

    Idle Timeout

    Required. The maximum amount of time a connection is allowed to sit idle in the pool. A value of 0 indicates that idle connections are never removed from the pool.

    Default value: 5

    Checkout timeout

    Required. Number of milliseconds to wait for a connection to be available when the pool is exhausted. Zero waits forever. An exception will be thrown after the wait time has expired.

    Default value: 10000

    URL Properties 

    URL property name

    URL property name

    Default value: [None]

    URL property value

    URL property value

    Default value: [None]

    Account Encryption

    Standard Encryption

    If you are using Standard Encryption, the High sensitivity settings under Enhanced Encryption are followed.


    Enhanced Encryption

    If you have the Enhanced Account Encryption feature, the following describes which fields are encrypted for each sensitivity level selected per each account.

    • High: Password
    • Medium + High: Password
    • Low + Medium + High: Password


    Azure SQL Active Directory Dynamic Account

    Expand
    titleAccount Settings

    With the Dynamic Account, you can specify the Hostname, Username, Database name,  and Password dynamically using Pipeline parameters since they support SnapLogic expressions. You will need to enable the expression-mode by clicking the  button to pass values dynamically as Pipeline parameters. 

    Account Settings

    Label

    		Required. User provided label for the account instance.

    Account properties

    		Required. Enter in the information to create a connection to the database.

    Hostname

    Required. The server's address to connect to.

    Default value: [None]

    Port Number

    Required. The database server's port to connect to.

    Default value: 1433

    Database name

    Required. The database name to connect to.

    Default value: [None]

    Username


    Username that is allowed to connect to the database. Username will be used as the default username when retrieving connections. The username must be valid in order to set up the data source.

    Default value: [None]

    Password


    Password used to connect to the data source. Password wil be used as the default password when retrieving connections. The password must be valid in order to set up the data source.

    Default value: [None]

    Trust all certificates

    Select if all SSL certificates are to be accepted for connecting to the database

    Default value: Not selected

    Advanced properties

    Auto commit

    When selected, each of the batches is committed immediately after it is executed. If the Snap fails, only the batch being executed at that moment is rolled back.

    When deselected, the Snap execution output is committed only after all the batches are executed. If the Snap fails, the entire transaction is rolled back, unless the Snap finds invalid input data before it sends the insert request to the server, and routes the error documents to the Error view.

    Default value: Selected

    Batch size

    Required. Number of statements to execute at a time.

    Select queries are not batched.

    Using a large batch size could use up the JDBC placeholder limit of 2100.

    Default value: 50

    Fetch size

    Required. Number of rows to fetch at a time when executing a query.

    Large values could cause the server to run out of memory.

    Default value: 100

    Max pool size

    Required. Maximum number of connections a pool will maintain at a time.

    Default value: 50

    Max life time

    Required. Maximum lifetime of a connection in the pool. Ensure that the value you enter is a few seconds shorter than any database or infrastructure-imposed connection time limit. A value of 0 indicates an infinite lifetime, subject to the Idle Timeout value. An in-use connection is never retired. Connections are removed only after they are closed.

    Default value: 30

    Idle Timeout

    Required. The maximum amount of time a connection is allowed to sit idle in the pool. A value of 0 indicates that idle connections are never removed from the pool.

    Default value: 5

    Checkout timeout

    Required. Number of milliseconds to wait for a connection to be available when the pool is exhausted. Zero waits forever. An exception will be thrown after the wait time has expired.

    Default value: 10000

    URL Properties

    URL property name

    URL property name

    Default value: [None]

    URL property value

    URL property value

    Default value: [None]

    Account Encryption

    Standard Encryption

    If you are using Standard Encryption, the High sensitivity settings under Enhanced Encryption are followed.


    Enhanced Encryption

    If you have the Enhanced Account Encryption feature, the following describes which fields are encrypted for each sensitivity level selected per each account.

    • High: Password
    • Medium + High: Password
    • Low + Medium + High: Password



    Insert excerpt
    Azure SQL Snap Pack
    Azure SQL Snap Pack
    nopaneltrue