Snowflake Snap Pack
In this article
Overview
Snowflake is a cloud data warehouse (CDW). Use Snaps in this Snap Pack to:
Insert, upsert, update, unload, execute, and delete records in Snowflake.
Query a specific Snowflake instance and return the requested records or keys.
Execute multiple queries.
Enable SCD2 to track the history of changes.
The following Snaps support AWS S3, Azure Blob, and Google Cloud Storage for external staging:
Snowflake - Bulk Load
Snowflake - Bulk Upsert
Snowflake - Unload
The Snowflake Snap Pack supports Snowflake vectors, including schema generation and output compatibility with vector data types.
Important update from Snowflake about deprecated drivers:
As of February 1, 2024, Snowflake has ceased support of older driver versions in compliance with its Support Policy. You must upgrade to the latest driver version to access important security, performance, and functionality improvements. Ensure that your Snowflake pipelines use the Snowflake JDBC Driver v3.13.27 or a higher version. Learn how to check your current driver version. The Snowflake Snap Pack is bundled with the 3.16.0 JDBC driver, but if you are using your own version, it may be deprecated in accordance with Snowflake Guidelines.
Prerequisites
Snowflake JDBC driver JAR v3.0.0 or higher (tested and supported with the JDBC driver version 3.16.0).
For the
GEOMETRY
data type, JDBC driver JAR v3.13.28 or higher is requiredUser-defined functions (UDFs) created in the Snowflake console can be executed using Snowflake - Execute and Snowflake - Multi Execute Snaps.
In this Section
- Configuring Snowflake Accounts
- Configure Cross Account IAM Role Support for Snowflake Snaps
- Configure Security Integration in Snowflake to use in Snowflake OAuth2 Accounts
- Configure the settings for Snowflake S3 Dynamic Account
- Create Storage Integration for Google Cloud Storage
- Configure Snowflake OAuth External Authentication with Okta
- Snowflake Azure Database Account
- Snowflake Azure OAuth2 Account
- Snowflake Google Storage Database Account
- Snowflake Google Storage OAuth2 Account
- Snowflake S3 Database Account
- Snowflake S3 Dynamic Account
- Snowflake S3 OAuth2 Account
- Snowflake - Bulk Load
- Snowflake - Bulk Upsert
- Snowflake - Delete
- Snowflake - Execute
- Snowflake - Insert
- Snowflake - Lookup
- Snowflake - Multi Execute
- Snowflake SCD2
- Snowflake - Select
- Snowflake – Snowpipe Streaming
- Snowflake - Table List
- Snowflake - Unload
- Snowflake - Update
- Snowflake - Vector Search
- Use Case: Move Data Using Snowflake Snap Pack
Supported Versions
This Snap Pack is tested with JDBC driver version 3.16.0.
As of November 8, 2023, the Snowflake Snap Pack is bundled with the default Snowflake JDBC driver v3.16.0.
As of November 1, 2023, Snowflake instances hosted on Google Cloud must use Snowflake JDBC driver v3.13.25 or higher. If you are using the default drivers bundled with Snowflake or ELT Snaps, your pipelines are not affected. If your Snowflake instances hosted on Google Cloud use older JARs, you must update the client drivers. Learn more.
For support of all geospatial data types, we recommend that you use our custom JDBC driver. Contact support@snaplogic.com for details.
Snap Pack History
Release | Snap Pack Version | Date | Type | Updates |
---|---|---|---|---|
November 2024 | main29029 | Nov 13, 2024 | Stable | Updated and certified against the current SnapLogic Platform release. |
August 2024 | 438patches28811 | Nov 1, 2024 | Latest | Fixed an issue with the Snowflake Snaps where the Snaps intermittently displayed an error requesting to |
August 2024 | 438patches28667 | Nov 1, 2024 | Latest | Added the Snowflake - Snowpipe Streaming Snap that enables data insertion into Snowflake using the Snowpipe Streaming API. It allows for continuous data ingestion into Snowflake tables as soon as data becomes available. |
August 2024 | main27765 | Aug 21, 2024 | Stable | Upgraded the |
May 2024 | 437patches27531 | Aug 7, 2024 | Latest | Enhanced the Snowflake - Select Snap with Time Travel query support that enables you to access historical data at any point within a defined period. This includes restoring data-related objects, duplicating and backing up data, and analyzing data usage. |
May 2024 | 437patches27156 | Jul 10, 2024 | Latest |
|
May 2024 | 437patches26821 | Jun 27, 2024 | Latest |
|
May 2024 | 437patches26508 | May 28, 2024 | Latest |
|
May 2024 | main26341 | May 8, 2024 | Stable |
|
February 2024 | 436patches25630 | Mar 28, 2024 | Latest |
|
February 2024 | main25112 | Feb 14, 2024 | Stable | Updated and certified against the current SnapLogic Platform release. |
November 2023 | 435patches24865 | Feb 5, 2024 | Latest | Fixed an issue across the Snowflake Snaps that populated all suggestions for the Schema and Table Names existing in the configured Snowflake Account. Now, the Snaps only populate suggestions related to the database configured in the Account. |
November 2023 | 435patches24110 | Dec 14, 2023 | Latest | Added a lint warning to the Snowflake-Bulk Load Snap that recommends users to select the Purge checkbox when the Data source is input view and the Staging location is External. |
November 2023 | main23721 | Nov 8, 2023 | Stable | The Snowflake Snap Pack is now bundled with the default Snowflake JDBC driver v3.14. |
August 2023 | 434patches23541 | Oct 30, 2023 | Latest | Fixed an issue with the Snowflake-Bulk Load Snap where the Snap wrote irrelevant errors to the error view when both of the following conditions occurred:
Now, the Snap writes the correct errors to the error view. |
August 2023 | main22460 | Aug 16, 2023 | Stable | The Snowflake - Execute Snap now includes a new Query type field. When Auto is selected, the Snap tries to determine the query type automatically. |
May 2023 | 433patches21890 | Jul 17, 2023 | Latest |
|
May 2023 | 433patches21370 | Jun 2, 2023 | Latest |
|
May 2023 | main21015 | May 10, 2023 | Stable |
|
February 2023 | 432patches20906 | May 9, 2023 | Latest |
|
February 2023 | 432patches20266 | Apr 3, 2023 | Latest | Fixed an issue with the Snowflake - Bulk Load Snap that resulted in lowercase (or mixed case) column names when creating a new table under specific conditions. The new Create table with uppercase column names checkbox addresses this issue. |
February 2023 | 432patches20120 | Mar 9, 2023 | Latest | The Snowflake Bulk Load, Bulk Upsert, and Unload Snaps now support expressions for the Staging location field. |
February 2023 | main19844 | Feb 9, 2023 | Stable |
|
November 2022 | 431patches19581 | Jan 20, 2023 | Latest |
|
November 2022 | 431patches19454 | Jan 12, 2023 | Latest | The Snowflake Snap Pack supports geospatial data types. As the Snowflake Snap Pack requires using our custom Snowflake JDBC driver for full support of all data types, contact support@snaplogic.com for details. |
November 2022 | 431patches19220 | Dec 8, 2022 | Latest | The Snowflake S3 OAuth2 Account now support expressions for external staging fields. |
November 2022 | 431patches19220
| Dec 8, 2022 | Latest |
|
November 2022 | main18944 | Nov 10, 2022 | Stable |
|
November 2022 | 430patches18911 | Nov 8, 2022 | Latest | Because of performance issues, all Snowflake Snaps now ignore the Cancel queued queries when pipeline is stopped or if it fails option for Manage Queued Queries, even when selected. Snaps behave as though the default Continue to execute queued queries when the Pipeline is stopped or if it fails option were selected. |
October 2022 | 430patches18781 | Oct 27, 2022 | Latest | The Snowflake Insert and Snowflake Bulk Upsert Snaps now do not fail with the The Snowflake Bulk Load Snap now works as expected when you configure On Error with SKIP_FILE_*error_percent_limit*% and set the Error Percent Limit to more than the percentage of rows with invalid data in the CSV file. |
October 2022 | 430patches18432 | Oct 13, 2022 | Latest | The Snowflake Bulk Load Snap now has a Validation Errors Type dynamic field, which provides options for displaying validation errors. You can now choose Aggregate errors per row to display a summary view of errors. |
September 2022 | 430patches17962 | Sep 19, 2022 | Latest | The Snowflake Bulk Load Snap now triggers the metadata query only once even for invalid input, thereby improving the performance of Snap. |
September 2022 | 430patches17894 | Sep 15, 2022 | Latest | The Snowflake Select Snap now works as expected when the table name is dependent on an upstream input. |
August 2022 | 430patches17748 | Sep 2, 2022 | Latest | Fixes in the Snowflake Bulk Load Snap:
|
August 2022 | 430patches17377 | Aug 25, 2022 | Latest |
|
August 2022 | main17386 | Aug 11, 2022 | Stable | The following Snowflake Accounts support Key Pair Authentication. |
4.29 Patch | 429patches16478 | Jul 21, 2022 | Latest | Fixed an issue with Snowflake - Bulk Load Snap where Snap failed with 301 status code - SnapDataException. |
4.29 Patch | 429patches16458 | Jun 27, 2022 | Latest |
|
4.29 | main15993 | May 14, 2022 | Stable | Upgraded with the latest SnapLogic Platform release. |
4.28 Patch | 428patches15236 | Apr 12, 2022 | Latest |
|
4.28 | main14627 | Feb 12, 2022 | Stable |
|
4.27 | 427patches12999 | Nov 23, 2021 | Latest | Enhanced the Snowflake SCD2 Snap to support Pipeline parameters for Natural key and Cause-historization fields. |
4.27 | main12833 | Nov 13, 2021 | Stable |
|
4.26 Patch | 426patches11469 | Sep 3, 2021 | Latest | Fixed an issue with Snowflake Insert and Snowflake Bulk Load Snaps where the schema names or database names containing underscore (_) caused the time out of Pipelines. |
4.26 | main11181 | Aug 14, 2021 | Stable |
|
4.25 | 425patches10190 | Jul 7, 2021 | Latest | Enhanced the Snowflake S3 Database and Snowflake S3 Dynamic accounts with a new field S3 AWS Token that allows you to connect to private and protected Amazon S3 buckets. |
4.25 | main9554 | May 8, 2021 | Stable | Upgraded with the latest SnapLogic Platform release. |
4.24 Patch | 424patches8905 | Apr 14, 2021 | Latest | Enhanced the Snowflake - Bulk Load Snap to allow transforming data using a new field Select Query before loading data into the Snowflake database. This option enables you to query the staged data files by either reordering the columns or loading a subset of table data from a staged file. This Snap supports CSV and JSON file formats for this data transformation. |
4.24 | main8556 | Feb 13, 2021 | Stable | Enhanced the Snowflake - Select Snap to return only the selected output fields or columns in the output schema (second output view) using the Fetch Output Fields In Schema check box. If the Output Fields field is empty all the columns are visible. |
4.23 Patch | 423patches7905 | Dec 28, 2020 | Latest | Fixed the performance issue in the Snowflake - Bulk Load Snap while using External Staging on Amazon S3. |
4.23 | main7430 | Nov 14, 2020 | Stable |
|
4.22 Patch | 422patches7246 | Nov 6, 2020 | Latest | Fixed an issue with the Snowflake Snaps that failed while displaying similar error in the Snowflake URL connection: |
4.22 Patch | 422patches6849 | Oct 16, 2020 | Latest |
|
4.22 | main6403 | Sep 12, 2020 | Stable | Updated with the latest SnapLogic Platform release. |
4.21 Patch | 421patches6272 | Jul 27, 2020 | Latest | Fixes the issue where Snowflake SCD2 Snap generates two output documents despite no changes to Cause-historization fields with DATE, TIME and TIMESTAMP Snowflake data types, and with Ignore unchanged rows field selected. |
4.21 Patch | 421patches6144 | Jul 2, 2020 | Latest |
|
4.21 Patch | db/snowflake8860 | Jun 2, 2020 | Latest | Added a new field, Handle Timestamp and Date Time Data, to Snowflake Lookup Snap. This field enables you to decide whether the Snap should translate UTC time to your local time and the format of the Date Time data. |
4.21 Patch | MULTIPLE8841 | May 19, 2020 | Latest | Fixed the connection issue in Database Snaps by detecting and closing open connections after the Snap execution ends. |
4.21 | snapsmrc542 | May 9, 2020 | Stable | Upgraded with the latest SnapLogic Platform release. |
4.20 Patch | db/snowflake8800 | Apr 14, 2020 | Latest |
|
4.20 Patch | db/snowflake8758 | Mar 3, 2020 | Latest | Re-release of fixes from db/snowflake8687 for 4.20: Fixes the Snowflake Bulk Load snap where the Snap fails to load documents containing single quotes when the Load empty strings checkbox is not selected. |
4.20 | snapsmrc535 | Feb 8, 2020 | Stable | Upgraded with the latest SnapLogic Platform release. |
4.19 Patch | db/snowflake8687 | Feb 4, 2020 | Latest | Fixed the Snowflake Bulk Load snap where the Snap fails to load documents containing single quotes when the Load empty strings checkbox is not selected. |
4.19 Patch | db/snowflake8499 | Jan 4, 2020 | Latest | Added the property Handle Timestamp and Date Time Data to Snowflake - Execute and Snowflake - Select Snaps. This property enables you to decide whether the Snap should translate UTC time to your local time. |
4.19 Patch | db/snowflake8412 | Dec 13, 2019 | Latest | Fixed an issue with the Snowflake - Update Snap wherein the Snap is unable to perform operations when:
|
4.19 | snaprsmrc528 | Nov 14, 2019 | Stable |
|
4.18 Patch | db/snowflake8044 | Oct 14, 2019 | Latest | Fixed an issue with the Snowflake - Select Snap wherein the Snap converts the Snowflake-provided timestamp value to the local timezone of the account. |
4.18 Patch | db/snowflake8044 | Oct 14, 2019 | Latest | Enhanced the Snap Pack to support AWS SDK 1.11.634 to fix the NullPointerException issue in the AWS SDK. This issue occurred in AWS-related Snaps that had HTTP or HTTPS proxy configured without a username and/or password. |
4.18 Patch | MULTIPLE7884 | Oct 9, 2019 | Latest | Fixed an issue with the PostgreSQL grammar to better handle the single quote characters. |
4.18 Patch | db/snowflake7821 | Sep 16, 2019 | Latest | Fixed an issue with the Snowflake - Execute Snap wherein the Snap is unable to support the '$' character in query syntax. |
4.18 Patch | MULTIPLE7778 | Aug 28, 2019 | Latest | Updated the AWS SDK library version to default to Signature Version 4 Signing process for API requests across all regions. |
4.18 Patch | db/snowflake7739 | Aug 20, 2019 | Latest |
|
4.18 | snapsmrc523 | Aug 10, 2019 | Stable | Added the Use Result Query property to the Multi Execute Snap, which enables you to write results to an output view. |
4.17 | ALL7402 | Jun 11, 2019 | Latest | Pushed automatic rebuild of the latest version of each Snap Pack to SnapLogic UAT and Elastic servers. |
4.17 Patch | db/snowflake7396 | Jun 10, 2019 | Latest | Fixed an issue wherein bit data types in the Snowflake - Select table convert to true or false instead of 0 or 1. |
4.17 Patch | db/snowflake7334 | May 31, 2019 | Latest | Added AWS Server-Side Encryption support for AWS S3 and AWS KMS (Key Management Service) for Snowflake Bulk Load, Snowflake Bulk Upsert, and Snowflake Unload Snaps. |
4.17 | snapsmrc515 | Jun 11, 2019 | Latest |
|
4.16 Patch | db/snowflake6945 | Mar 13, 2019 | Latest | Fixed an issue with the Snowflake Lookup Snap failing when Date datatype is used in JavaScript functions. |
4.16 Patch | db/snowflake6928 | Mar 8, 2019 | Latest | Added support for file format options for input data from upstream Snaps, to the Snowflake Bulk Load Snap. |
4.16 Patch | db/snowflake6819 | Feb 22, 2019 | Latest |
|
4.16 | snapsmrc508 | Feb 16, 2019 | Stable |
|
4.15 | snapsmrc500 | Dec 15, 2018 | Stable |
|
4.14 | snapsmrc490 | Aug 11, 2018 | Stable | Upgraded with the latest SnapLogic Platform release. |
4.13 | snapsmrc486 | May 12, 2018 | Stable | Upgraded with the latest SnapLogic Platform release. |
4.12 | snapsmrc480 | Feb 17, 2018 | Stable | Upgraded with the latest SnapLogic Platform release. |
4.11 Patch | MULTIPLE4377 | Dec 18, 2017 | Latest | Fixed a document call issue that was slowing down the Snowflake Bulk Load Snap. |
4.11 Patch | db/snowflake4283 | Nov 16, 2017 | Latest | Snowflake Bulk Load - Fixed an issue by adding PUT command to the list of DDL command list for Snowflake. |
4.11 Patch | db/snowflake4273 | Nov 14, 2017 | Latest | Snowflake Bulk Load - Resolved an issue with Snowflake Bulk Load Delimiter Consistency (comma and newline). |
4.11 | snapsmrc465 | Nov 11, 2017 | Stable | Upgraded with the latest SnapLogic Platform release. |
4.10 Patch | snowflake4133 |
| Latest | Updated the Snowflake Bulk Load Snap with Preserve case sensitivity property to preserve the case sensitivity of column names. |
4.10 | snapsmrc414 | Aug 12, 2017 | Stable |
|
4.9.0 Patch | snowflake3234 | Jul 6, 2017 | Latest | Enhanced Snowflake - Execute Snap results to include additional details |
4.9.0 Patch | snowflake3125 | Jun 22, 2017 | Latest | Addressed an issue in Snowflake Bulk Load where the comma character in a value is not escaped. |
4.9 | snapsmrc405 | May 13, 2017 | Stable | JDBC Driver Class property added to enable the user to custom configure the JDBC driver in the Database and the Dynamic accounts. |
4.8.0 Patch | snowflake2760 | Mar 27, 2017 | Latest | Potential fix for JDBC deadlock issue. |
4.8.0 Patch | snowflake2739 | Mar 9, 2017 | Latest | Addressed an issue with the Snowflake schema not correctly represented in the Mapper Snap. |
4.8 | snapsmrc398 | Feb 11, 2017 | Stable |
|
Related Content
Video Series: Teradata to Snowflake Migration
Have feedback? Email documentation@snaplogic.com | Ask a question in the SnapLogic Community
© 2017-2024 SnapLogic, Inc.