Redshift Snap Pack
- Kalpana Malladi
- Diane Miller (Deactivated)
- Lakshmi Manda
Overview
Amazon Redshift is a data warehousing service in the cloud.
Use Snaps in this Snap Pack to:
- Lookup records in the target Redshift table and return a selected set of fields for every matched record.
- Output a list of tables in a database.
- Fetch data from a database by providing a table name and configuring the connection.
- Execute a Redshift bulk load or bulk upsert.
- Execute a SQL delete, a SQL Insert statement, or a SQL update.
Provide functionality of SCD (Slowly Changing Dimension) Type 2 on the target Redshift table.
Limitations
Redshift operations against Redshift system views and tables are not supported.
If you use the PostgreSQL driver (
org.postgresql.Driver
) with the Redshift Snap Pack, it could result in errors if the data type provided to the Snap does not match the data type in the Redshift table schema. Either use the Redshift driver (com.amazon.redshift.jdbc42.Driver
) or use the correct data type in the input document to resolve these errors.
Articles in this section
- Migrating from the PostgreSQL JDBC Driver to the Amazon Redshift JDBC Driver
- Setup for Redshift Cross Account IAM Role
- Configuring Redshift Accounts
- Redshift - Bulk Load
- Redshift - Bulk Upsert
- Redshift - Delete
- Redshift - Insert
- Redshift - Lookup
- Redshift - Multi Execute
- Redshift - S3 Upsert
- Redshift - SCD2
- Redshift - Select
- Redshift - Execute
- Redshift - Table List
- Redshift - Unload
- Redshift - Update
Redshift IAM Account Setup
- If the EC2 plex (where your pipeline is running with an IAM role), Redshift cluster, and S3 bucket are in the same AWS account, then you must use the SnapLogic Redshift Account (regular IAM Account).
- If the EC2 plex (where your pipeline is running with an IAM role) is in one account and the Redshift cluster and S3 bucket are in a different AWS account, you must use the SnapLogic Redshift Cross-Account IAM Role Account to run your pipelines successfully.
This applies only to the Redshift - Bulk Load, Redshift - Unload, and Redshift - S3 Upsert Snaps.
Supported Versions
This Snap Pack is tested against:
- PostgreSQL 8.0.2
- Redshift 1.0.69065 (Redshift-JDBC 42-2.1.0.29.jar)
Snap Pack History
Release | Snap Pack Version | Date | Type | Updates |
---|---|---|---|---|
August 2024 | main27765 | | Stable |
|
May 2024 | 437patches26634 | Latest | Fixed an issue with Redshift - Execute Snap that produced logs causing node crashes. | |
May 2024 | main26341 | Stable | Updated the Delete Condition (Truncates a Table if empty) field in the Redshift - Delete Snap to Delete condition (deletes all records from a table if left blank) to indicate that all entries will be deleted from the table when this field is blank, but no truncate operation is performed. | |
February 2024 | main25112 | Stable | Updated and certified against the current SnapLogic Platform release. | |
November 2023 | main23721 |
| Stable | Updated and certified against the current SnapLogic Platform release. |
August 2023 | main22460 | Stable |
Behavior Change Starting with
| |
May 2023 | main21015 | Stable | Upgraded with the latest SnapLogic Platform release. | |
February 2023 | 432patches20500 | Latest | The Redshift Account no longer fails when a URL is entered in the JDBC URL field and no driver is specified. | |
February 2023 | 432patches20166 | Latest | Updated the description for S3 Security Token field as follows: Specify the S3 security token part of AWS Security Token Service (STS) authentication. It is not required unless a particular S3 credential is configured to require it. | |
February 2023 | 432patches20101 |
| Latest |
|
February 2023 | 432patches20035 |
| Latest | The Redshift Snaps that earlier supported only Redshift Cluster now support Redshift Serverless as well. With Redshift Serverless, you can avoid setting up and managing data warehouse infrastructure when you run or scale analytics. |
February 2023 | main19844 | Stable | Upgraded with the latest SnapLogic Platform release. | |
November 2022 | main18944 | Stable | The Redshift - Insert Snap now creates the target table only from the table metadata of the second input view when the following conditions are met:
| |
August 2022 | 430patches17189 | Latest |
| |
August 2022 | main17386 | Stable | The Redshift accounts support:
| |
4.29 Patch | 429patches16908 | Latest |
| |
4.29 Patch | 429patches15806 | Latest | Fixed an issue with Redshift Account and Redshift SSL Account where the Redshift Snaps failed when the S3 Secret key or S3 Access-key ID contained special characters, such as +. | |
4.29 | main15993 |
| Stable | Upgraded with the latest SnapLogic Platform release. |
4.28 | main14627 | Stable | Updated the label for Delete Condition to Delete Condition (Truncates Table if empty) in the Redshift Delete Snap. | |
4.27 Patch | 427patches12999 | Latest | Fixed an issue with the Redshift Bulk Load Snap, where the temporary files in S3 were not deleted for aborted or interrupted Pipelines. | |
4.27 Patch | 427patches12999 | Latest |
| |
4.27 | main12833 | Stable | Enhanced the Redshift - Execute Snap to invoke stored procedures. | |
4.26 | main11181 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.25 Patch | 425patches11008 | Latest | Updated the AWS SDK from version 1.11.688 to 1.11.1010 in the Redshift Snap Pack and added a custom SnapLogic User Agent header value. | |
4.25 | main9554 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.24 | main8556 | Stable |
| |
4.23 | main7430 | Stable | Fixed an issue with the Redshift Bulk Load Snap that fails while displaying a | |
4.22 | main6403 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.21 Patch | 421patches6144 | Latest | Fixed the following issues with DB Snaps:
| |
4.21 Patch | MULTIPLE8841 | Latest | Fixed the connection issue in Database Snaps by detecting and closing open connections after the Snap execution ends. | |
4.21 | snapsmrc542 |
| Stable | Upgraded with the latest SnapLogic Platform release. |
4.20 Patch | db/redshift8774 | Latest | Fixed the Redshift - Execute Snap that hangs if the SQL statement field contains only a comment ("-- comment"). | |
4.20 | snapsmrc535 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.19 Patch | db/redshift8410 | Latest | Fixed an issue with the Redshift - Update Snap wherein the Snap is unable to perform operations when:
| |
4.19 | snaprsmrc528 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.18 Patch | db/redshift8043 | Latest | Enhanced the Snap Pack to support AWS SDK 1.11.634 to fix the NullPointerException issue in the AWS SDK. This issue occurred in AWS-related Snaps that had HTTP or HTTPS proxy configured without a username and/or password. | |
4.18 Patch | MULTIPLE7884 | Latest | Fixed an issue with the PostgreSQL grammar to better handle the single quote characters. | |
4.18 Patch | MULTIPLE7778 | Latest | Updated the AWS SDK library version to default to Signature Version 4 Signing process for API requests across all regions. | |
4.18 | snapsmrc523 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.17 Patch | db/redshift7433 | Latest | Fixed an issue with the Redshift Bulk Load Snap wherein the Snap fails to copy the entire data from source to the Redshift table without any statements being aborted. | |
4.17 | ALL7402 | Latest | Pushed automatic rebuild of the latest version of each Snap Pack to SnapLogic UAT and Elastic servers. | |
4.17 | snapsmrc515 | Latest |
| |
4.16 Patch | db/redshift6821 | Latest | Fixed an issue with the Lookup Snap passing data simultaneously to output and error views when some values contained spaces at the end. | |
4.16 | snapsmrc508 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.15 Patch | db/redshift6286 | Latest | Fixed an issue with the Bulk Upsert Snap wherein there was no output for any input schema. | |
4.15 Patch | db/redshift6334 | Latest | Replaced Max idle time and Idle connection test period properties with Max life time and Idle Timeout properties, respectively, in the Account configuration. The new properties fix the connection release issues that were occurring due to default/restricted DB Account settings. | |
4.15 | snapsmrc500 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.14 Patch | db/redshift5786 | Latest | Fixed an issue wherein the Redshift Upload snap logged the access and secret keys without encryption in the error logs. The keys are now masked. | |
4.14 Patch | db/redshift5667 | Latest |
| |
4.14 | snapsmrc490 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.13 Patch | db/redshift/5303 | Latest | Added a new property "Validate input data" in the Redshift Bulk Load Snap to help users troubleshoot the input data schema. | |
4.13 Patch | db/redshift5186 | Latest | Fixed the Bulk Load and Unload Snaps wherein the KMS encryption type property is failing with validation error. | |
4.13 | snapsmrc486 | Stable | Added KMS encryption support to these Snaps: Redshift Unload, Redshift Bulk Load, Redshift Bulk Upsert, and Redshift S3 Upsert. | |
4.12 Patch | db/redshift5027 | Latest | Fixed an issue wherein the Redshift Snaps timeout and fail to retrieve a database connection. | |
4.12 Patch | MULTIPLE4967 | Latest | Provided an interim fix for an issue with the Redshift accounts by re-registering the driver for each account validation. The final fix is being shipped in a separate build. | |
4.12 Patch | MULTIPLE4744 | Latest | Added support for Redshift grammar to recognize window functions as being part of the query statement. | |
4.12 | snapsmrc480 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.11 Patch | db/redshift4589 | Latest | Fixed an issue when creating a Redshift table via the second/metadata input view for the Redshift Bulk Load Snap. | |
4.11 | snapsmrc465 | Stable | Added SSL support to the Configuring Redshift Accounts. | |
4.10 Patch | db/redshift4115 | Latest | The Upsert or BulkUpdate/BulkLoad shall not execute and produce output when no inputView has been provided. | |
4.10 Patch | redshift3936 | Latest | Addressed an issue in Redshift Execute with a Select that hangs after extracting 13 million in the morning or 30 million in the evening | |
4.10 | snapsmrc414 | Stable | Added Auto commit property to the Select and Execute Snaps at the Snap level to support overriding of the Auto commit property at the Account level. | |
4.9.0 Patch | redshift3229 | Latest | Addressed an issue in Redshift Multiple Execute where INSERT INTO SELECT statement generated a 'transaction, commit and rollback statements are not supported' exception. | |
4.9.0 Patch | redshift3073 | Latest | Fixed an issue regarding connection not closed after login failure; Expose autocommit for "Select into" statement in PostgreSQL Execute Snap and Redshift Execute Snap | |
4.9 | snapsmrc405 | Stable |
| |
4.8.0 Patch | redshift2852 | Latest |
| |
4.8.0 Patch | redshift2799 | Latest |
| |
4.8.0 Patch | redshift2758 | Latest | Potential fix for JDBC deadlock issue. | |
4.8.0 Patch | redshift2713 | Latest | Fixed Redshift Snap Pack rendering dates that are one hour off from the date returned by database query for non-UTC Snaplexes | |
4.8.0 Patch | redshift2697 | Latest | Addresses an issue where some changes made in the platform patch MRC294 to improve performance caused Snaps in the listed Snap Packs to fail. | |
4.8 | snapsmrc398 | Stable |
| |
4.7.0 Patch | redshift2434 | Latest | Replaced newSingleThreadExecutor() with a fixed thread pool. | |
4.7.0 Patch | redshift2387 | Latest | Addressed an issue in Redshift Bulk Load Snap where Load Empty String was setting not working after release. | |
4.7.0 Patch | redshift2223 | Latest | Auto-commit is turned off automatically for SELECT | |
4.7.0 Patch | redshift2201 |
| Latest | Fixed an issue for database Select Snaps regarding Limit rows not supporting an empty string from a pipeline parameter. |
4.7 | snapsmrc382 | Stable |
| |
4.6 | snapsmrc362 | Stable |
| |
4.5.1 | redshift1621 | Latest |
| |
4.5 | snapsmrc344 | Stable |
| |
4.4.1 | NA | Latest | Resolved an issue with numeric precision when trying to use create table if not present in Redshift Insert Snap. | |
4.4 | NA | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.3.2 | NA | Stable |
| |
4.3 | NA | Stable |
| |
4.2 | NA | Latest |
| |
NA | NA | NA |
|
Have feedback? Email documentation@snaplogic.com | Ask a question in the SnapLogic Community
© 2017-2024 SnapLogic, Inc.