- Created by Diane Miller, last modified by Gouri Bhagchandani on Nov 11, 2022
You are viewing an old version of this page. View the current version.
Compare with Current View Page History
« Previous Version 207 Next »
In this article
Overview
Snowflake is a data warehousing service in the cloud.
Use Snaps in this Snap Pack to:
- Insert, upsert, update, unload, execute and delete records in Snowflake.
- Query a particular Snowflake instance and returns the requested records or keys.
- Execute multiple queries.
- Enable SCD2 type historization.
Supported Versions
This Snap Pack is tested against Snowflake Cloud 5.29.1(JDBC driver version: 3.13.22). User-defined functions (UDFs) created in the Snowflake console can be executed using Snowflake - Execute and Snowflake - Multi Execute Snaps.
Snowflake - Multi Execute Snaps support only write operations
The following Snaps support Azure Blob:
- Snowflake - Bulk Load
- Snowflake - Bulk Upsert
- Snowflake - Delete
Snowflake - Execute
Snowflake - Insert
Snowflake - Lookup
Snowflake - Select
Snowflake - Table List
Snowflake - Update
- Snowflake - Unload
In this section
Temporary Files
During execution, data processing on Snaplex nodes occurs principally in-memory as streaming and is unencrypted. When larger datasets are processed that exceeds the available compute memory, the Snap writes Pipeline data to local storage as unencrypted to optimize the performance. These temporary files are deleted when the Snap/Pipeline execution completes. You can configure the temporary data's location in the Global properties table of the Snaplex's node properties, which can also help avoid Pipeline errors due to the unavailability of space. For more information, see Temporary Folder in Configuration Options.Requirements
Snowflake JDBC jar 3.1.0 or higher (Tested and supported for the JDBC jar version 3.13.22).
We recommend you to use the latest version of the Snowflake JDBC jar driver (version 3.13.22) if you are experiencing slow or hanging execution when using Snowflake Snaps, as this is a known issue with an older version of drivers [Ref: https://github.com/snowflakedb/snowflake-jdbc/blob/master/CHANGELOG.rst].
Snap Pack History
Release | Snap Pack Version | Date | Type | Updates | |||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
November 2022 | main18944 |
| Stable |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||
November 2022 | 430patches18911 | Latest | Because of performance issues, all Snowflake Snaps now ignore the Cancel queued queries when pipeline is stopped or if it fails option for Manage Queued Queries, even when selected. Snaps behave as though the default Continue to execute queued queries when the Pipeline is stopped or if it fails option were selected. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
October 2022 | 430patches18781 | Latest | The Snowflake Insert and Snowflake Bulk Upsert Snaps now do not fail with the
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
October 2022 | 430patches18432 | Latest | The Snowflake Bulk Load Snap now has a Validation Errors Type dynamic field, which provides options for displaying validation errors. You can now choose Aggregate errors per row to display a summary view of errors. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
September 2022 | 430patches17962 | Latest | The Snowflake Bulk Load Snap now triggers the metadata query only once even for invalid input, thereby improving the performance of Snap. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
September 2022 | 430patches17894 | Latest | The Snowflake Select Snap now works as expected when the table name is dependent on an upstream input. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
August 2022 | 430patches17748 | Latest | Fixes in the Snowflake Bulk Load Snap:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
August 2022 | 430patches17377 | Latest |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
August 2022 | main17386 | Stable | The following Snowflake Accounts support Key Pair Authentication. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.29 Patch | 429patches16478 | Latest | Fixed an issue with Snowflake - Bulk Load Snap where Snap failed with 301 status code - SnapDataException. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.29 Patch | 429patches16458 | Latest |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.29 | main15993 | Stable | Upgraded with the latest SnapLogic Platform release. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.28 Patch | 428patches15236 | Latest |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.28 | main14627 | Stable |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.27 | 427patches12999 | Latest | Enhanced the Snowflake SCD2 Snap to support Pipeline parameters for Natural key and Cause-historization fields. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.27 | main12833 | Stable |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.26 Patch | 426patches11469 | Latest | Fixed an issue with Snowflake Insert and Snowflake Bulk Load Snaps where the schema names or database names containing underscore (_) caused the time out of Pipelines. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.26 | main11181 | Stable |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.25 | 425patches10190 | Latest | Enhanced the Snowflake S3 Database and Snowflake S3 Dynamic accounts with a new field S3 AWS Token that allows you to connect to private and protected Amazon S3 buckets. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.25 | main9554 | Stable | Upgraded with the latest SnapLogic Platform release. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.24 Patch | 424patches8905 | Latest | Enhanced the Snowflake - Bulk Load Snap to allow transforming data using a new field Select Query before loading data into the Snowflake database. This option enables you to query the staged data files by either reordering the columns or loading a subset of table data from a staged file. This Snap supports CSV and JSON file formats for this data transformation. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.24 | main8556 | Stable | Enhanced the Snowflake - Select Snap to return only the selected output fields or columns in the output schema (second output view) using the Fetch Output Fields In Schema check box. If the Output Fields field is empty all the columns are visible. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.23 Patch | 423patches7905 | Latest | Fixed the performance issue in the Snowflake - Bulk Load Snap while using External Staging on Amazon S3. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.23 | main7430 | Stable |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.22 Patch | 422patches7246 | Latest | Fixes an issue with the Snowflake Snaps that fail while displaying the same error message, javax.management.MalformedObjectNameException: Invalid character '=' in value part of property, repeatedly when there is “=“ or ”:” in the Snowflake URL connection. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.22 Patch | 422patches6849 | Latest |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.22 | main6403 | Stable | Upgraded with the latest SnapLogic Platform release. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.21 Patch | 421patches6272 | Latest | Fixes the issue where Snowflake SCD2 Snap generates two output documents despite no changes to Cause-historization fields with DATE, TIME and TIMESTAMP Snowflake data types, and with Ignore unchanged rows field selected. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.21 Patch | 421patches6144 | Latest |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.21 Patch | db/snowflake8860 | Latest | Added a new field, Handle Timestamp and Date Time Data, to Snowflake Lookup Snap. This field enables you to decide whether the Snap should translate UTC time to your local time and the format of the Date Time data. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.21 Patch | MULTIPLE8841 | Latest | Fixed the connection issue in Database Snaps by detecting and closing open connections after the Snap execution ends. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.21 | snapsmrc542 |
| Stable | Upgraded with the latest SnapLogic Platform release. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.20 Patch | db/snowflake8800 | Latest |
Snowflake Execute and Multi-Execute Snaps may break existing Pipelines if the JDBC Driver is updated to a newer version. With the updated JDBC driver (version 3.12.3), the Snowflake Execute and Multi-Execute Snaps' output displays a Status of "-1" instead of "0" without the Message field upon successfully executing DDL statements. If your Pipelines use these Snaps and downstream Snaps use the Status field's value from these, you must modify the downstream Snaps to proceed on a status value of -1 instead of 0. This change in the Snap behavior follows from the change introduced in the Snowflake JDBC driver in version 3.8.1: | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.20 Patch | db/snowflake8758 | Latest | Re-release of fixes from db/snowflake8687 for 4.20: Fixes the Snowflake Bulk Load snap where the Snap fails to load documents containing single quotes when the Load empty strings checkbox is not selected. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.20 | snapsmrc535 | Stable | Upgraded with the latest SnapLogic Platform release. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.19 Patch | db/snowflake8687 | Latest | Fixed the Snowflake Bulk Load snap where the Snap fails to load documents containing single quotes when the Load empty strings checkbox is not selected. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.19 Patch | db/snowflake8499 | Latest | Added the property Handle Timestamp and Date Time Data to Snowflake - Execute and Snowflake - Select Snaps. This property enables you to decide whether the Snap should translate UTC time to your local time. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.19 Patch | db/snowflake8412 | Latest | Fixed an issue with the Snowflake - Update Snap wherein the Snap is unable to perform operations when:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.19 | snaprsmrc528 | Stable |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.18 Patch | db/snowflake8044 | Latest | Fixed an issue with the Snowflake - Select Snap wherein the Snap converts the Snowflake-provided timestamp value to the local timezone of the account. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.18 Patch | db/snowflake8044 | Latest | Enhanced the Snap Pack to support AWS SDK 1.11.634 to fix the NullPointerException issue in the AWS SDK. This issue occurred in AWS-related Snaps that had HTTP or HTTPS proxy configured without a username and/or password. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.18 Patch | MULTIPLE7884 | Latest | Fixed an issue with the PostgreSQL grammar to better handle the single quote characters. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.18 Patch | db/snowflake7821 | Latest | Fixed an issue with the Snowflake - Execute Snap wherein the Snap is unable to support the '$' character in query syntax. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.18 Patch | MULTIPLE7778 | Latest | Updated the AWS SDK library version to default to Signature Version 4 Signing process for API requests across all regions. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.18 Patch | db/snowflake7739 | Latest |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.18 | snapsmrc523 | Stable | Added the Use Result Query property to the Multi Execute Snap, which enables you to write results to an output view. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.17 | ALL7402 | Latest | Pushed automatic rebuild of the latest version of each Snap Pack to SnapLogic UAT and Elastic servers. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.17 Patch | db/snowflake7396 | Latest | Fixed an issue wherein bit data types in the Snowflake - Select table convert to true or false instead of 0 or 1. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.17 Patch | db/snowflake7334 | Latest | Added AWS Server-Side Encryption support for AWS S3 and AWS KMS (Key Management Service) for Snowflake Bulk Load, Snowflake Bulk Upsert, and Snowflake Unload Snaps. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.17 | snapsmrc515 | Latest |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.16 Patch | db/snowflake6945 | Latest | Fixed an issue with the Snowflake Lookup Snap failing when Date datatype is used in JavaScript functions. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.16 Patch | db/snowflake6928 | Latest | Added support for file format options for input data from upstream Snaps, to the Snowflake Bulk Load Snap. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.16 Patch | db/snowflake6819 | Latest |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.16 | snapsmrc508 | Stable |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.15 | snapsmrc500 | Stable |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.14 | snapsmrc490 | Stable | Upgraded with the latest SnapLogic Platform release. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.13 | snapsmrc486 | Stable | Upgraded with the latest SnapLogic Platform release. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.12 | snapsmrc480 | Stable | Upgraded with the latest SnapLogic Platform release. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.11 Patch | MULTIPLE4377 | Latest | Fixed a document call issue that was slowing down the Snowflake Bulk Load Snap. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.11 Patch | db/snowflake4283 | Latest | Snowflake Bulk Load - Fixed an issue by adding PUT command to the list of DDL command list for Snowflake. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.11 Patch | db/snowflake4273 | Latest | Snowflake Bulk Load - Resolved an issue with Snowflake Bulk Load Delimiter Consistency (comma and newline). | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.11 | snapsmrc465 | Stable | Upgraded with the latest SnapLogic Platform release. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.10 Patch | snowflake4133 | Latest | Updated the Snowflake Bulk Load Snap with Preserve case sensitivity property to preserve the case sensitivity of column names. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.10 | snapsmrc414 | Stable |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.9.0 Patch | snowflake3234 | Latest | Enhanced Snowflake - Execute Snap results to include additional details | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.9.0 Patch | snowflake3125 | Latest | Addressed an issue in Snowflake Bulk Load where the comma character in a value is not escaped. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.9 | snapsmrc405 | Stable | JDBC Driver Class property added to enable the user to custom configure the JDBC driver in the Database and the Dynamic accounts. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.8.0 Patch | snowflake2760 | Latest | Potential fix for JDBC deadlock issue. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.8.0 Patch | snowflake2739 | Latest | Addressed an issue with the Snowflake schema not correctly represented in the Mapper Snap. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4.8 | snapsmrc398 | Stable |
|
See Also
- Snowflake Documentation
- Video Series: Teradata to Snowflake Migration
- No labels