On this Page
Table of Contents | ||||||
---|---|---|---|---|---|---|
|
You can create an account from Designer or Manager. In Designer, when working on pipelines, every Snap that needs an account prompts you to create a new account or use an existing account. The accounts can be created in or used from:
- Your private project folder: This folder contains the pipelines that will use the account.
- Your Project Space’s shared folder: This folder is accessible to all the users that belong to the Project Space.
- The global shared folder: This folder is accessible to all the users within an organization in the SnapLogic instance.
Account Configuration
In Manager, you can navigate to the required folder and create an account in it (see Accounts). To create an account for binary files:
- Click Create, then select Redshift > Redshift Account.
- Supply an account label.
Supply the necessary information.
- URL parameters to be specified to ensure SSL connectivity:
ssl=true
- The S3 Bucket, S3 Access-key ID and S3 Secret key properties are required for Redshift-Bulk Load and Redshift-Bulk Upsert Snaps. The S3 Folder property may be used for the staging file. If the S3 Folder property is left blank, the staging file will be stored in the bucket.
- URL parameters to be specified to ensure SSL connectivity:
- (Optional) Supply additional information on this account in the Notes field of the Info tab.
- Click Apply.
Warning |
---|
Avoid changing account credentials while pipelines using them are in progress. This may lead to unexpected results, including locking the account. |
Note |
---|
If the Snap fails to connect to the database, it will retry three more times. |
Note |
---|
While selecting an Account on a Redshift SSL instance, you can use the JDBC driver v1.2.8.1005 or greater to validate it. However, when not using the Amazon's Redshift JDBC driver v1.2.8.1005 or greater, you would be required to manually import an updated certificate into their TrustStore or, simply use the Redshift SSL Account. |
Account Types
Redshift Account
Expand | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Expand | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Default value: 50 Max life time | Required. Maximum lifetime of a connection in the pool. Ensure that the value you enter is a few seconds shorter than any database or infrastructure-imposed connection time limit. A value of 0 indicates an infinite lifetime, subject to the Idle Timeout value. An in-use connection is never retired. Connections are removed only after they are closed. Default value: 30 Idle Timeout | Required. The maximum amount of time a connection is allowed to sit idle in the pool. A value of 0 indicates that idle connections are never removed from the pool. Default value: 5 Checkout timeout | Required. Number of milliseconds to wait for a connection to be available when the pool is exhausted. Zero waits forever. An exception will be thrown after the wait time has expired. | Default value: 10000 URL Properties | URL property name | URL property name Default value: [None] URL property value | URL property value Default value: [None] Account Encryption | Standard Encryption | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Enhanced Encryption | If you have the Enhanced Account Encryption feature, the following describes which fields are encrypted for each sensitivity level selected per each account. Account:
|
Redshift SSL Account
Account Encryption
|
Redshift SSL Account
Expand | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Default value: 50 Fetch size | Required. Number of rows to fetch at a time when executing a query.
Default value: 100 Max pool size | Required. Maximum number of connections a pool will maintain at a time.
Default value: 50 Max life time | Required. Maximum lifetime of a connection in the pool. Ensure that the value you enter is a few seconds shorter than any database or infrastructure-imposed connection time limit. A value of 0 indicates an infinite lifetime, subject to the Idle Timeout value. An in-use connection is never retired. Connections are removed only after they are closed. Default value: 30 Idle Timeout | Required. The maximum amount of time a connection is allowed to sit idle in the pool. A value of 0 indicates that idle connections are never removed from the pool. Default value: 5 Checkout timeout | Required. Number of milliseconds to wait for a connection to be available when the pool is exhausted. Zero waits forever. An exception will be thrown after the wait time has expired. | Default value: 10000 URL Properties | URL property name | URL property name Default value: [None] URL property value | URL property value Default value: [None] Account Encryption | Standard Encryption | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Enhanced Encryption | If you have the Enhanced Account Encryption feature, the following describes which fields are encrypted for each sensitivity level selected per each account. Account:
|
Auto Commit with Execute Snaps
For a DB Execute Snap, assume that a stream of documents enters the input view of the Snap and the SQL statement property has JSON paths in the WHERE clause. If the number of documents are large, the Snap executes in more than one batches rather than executing one per each document. Each batch would contain a certain number of WHERE clause values. If Auto commit is turned on, a failure would only roll back the records in the current batch. If Auto commit is turned off, the entire operation would be rolled back. For a single execute statement (with no input view), the setting has no practical effect.
Panel | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
Account History Expand | | |||||||
|
S3 Secret key | S3 Secret key part of AWS Authentication.
Default value: [None] | |||||||
---|---|---|---|---|---|---|---|---|
KeyStore | The location of the key store file, can be in SLDB or any other unauthenticated endpoint such as https://... Example: shared/client_keystore.jks Default value: [None] | |||||||
TrustStore | The location of the trust store file, can be in SLDB or any other unauthenticated endpoint such as https://... Example: shared/client_truststore.jks Default value: [None] | |||||||
Key/Trust store password | Password for key/trust store, it is used for both if both are defined. Default value: [None] | |||||||
Key alias | Define the key being used via its alias Default value: [None] | |||||||
IAM properties | ||||||||
AWS account ID | ID of the Amazon Web Services account to be used for performing bulk load operation.
Default value: [None] | |||||||
IAM role name | Name of the IAM role that has been assigned to the redshift cluster to access the S3 bucket provided above.
Default value: [None] | |||||||
Region name | Name of the region the Redshift cluster belongs to. Default value: [None] | |||||||
Advanced properties | ||||||||
Auto commit | When selected, each of the batches is committed immediately after it is executed. If the Snap fails, only the batch being executed at that moment is rolled back. When deselected, the Snap execution output is committed only after all the batches are executed. If the Snap fails, the entire transaction is rolled back, unless the Snap finds invalid input data before it sends the insert request to the server, and routes the error documents to the Error view. Default value: Selected | |||||||
Batch size | Required. Number of statements to execute at a time.
Default value: 50 | |||||||
Fetch size | Required. Number of rows to fetch at a time when executing a query.
Default value: 100 | |||||||
Max pool size | Required. Maximum number of connections a pool will maintain at a time.
Default value: 50 | |||||||
Max life time | Required. Maximum lifetime of a connection in the pool. Ensure that the value you enter is a few seconds shorter than any database or infrastructure-imposed connection time limit. A value of 0 indicates an infinite lifetime, subject to the Idle Timeout value. An in-use connection is never retired. Connections are removed only after they are closed. Default value: 30 | |||||||
Idle Timeout | Required. The maximum amount of time a connection is allowed to sit idle in the pool. A value of 0 indicates that idle connections are never removed from the pool. Default value: 5 | |||||||
Checkout timeout | Required. Number of milliseconds to wait for a connection to be available when the pool is exhausted. Zero waits forever. An exception will be thrown after the wait time has expired. Default value: 10000 | |||||||
URL Properties | ||||||||
URL property name | URL property name Default value: [None] | |||||||
URL property value | URL property value Default value: [None] |
Account Encryption
Standard Encryption | If you are using Standard Encryption, the High sensitivity settings under Enhanced Encryption are followed. | |
---|---|---|
Enhanced Encryption | If you have the Enhanced Account Encryption feature, the following describes which fields are encrypted for each sensitivity level selected per each account. Account:
|
Auto Commit with Execute Snaps
For a DB Execute Snap, assume that a stream of documents enters the input view of the Snap and the SQL statement property has JSON paths in the WHERE clause. If the number of documents are large, the Snap executes in more than one batches rather than executing one per each document. Each batch would contain a certain number of WHERE clause values. If Auto commit is turned on, a failure would only roll back the records in the current batch. If Auto commit is turned off, the entire operation would be rolled back. For a single execute statement (with no input view), the setting has no practical effect.
Insert excerpt | ||||||
---|---|---|---|---|---|---|
|