Snowflake Snap Pack
PIn this article
Overview
Snowflake is a cloud data warehouse (CDW). Use Snaps in this Snap Pack to:
Insert, upsert, update, unload, execute, and delete records in Snowflake.
Query a specific Snowflake instance and return the requested records or keys.
Execute multiple queries.
Enable SCD2 to track the history of changes.
The following Snaps support AWS S3, Azure Blob, and Google Cloud Storage for external staging:
Snowflake - Bulk Load
Snowflake - Bulk Upsert
Snowflake - Unload
The Snowflake Snap Pack supports Snowflake vectors, including schema generation and output compatibility with vector data types.
Supported Versions
This Snap Pack is tested with JDBC driver version 3.14.0.
As of November 8, 2023, the Snowflake Snap Pack is bundled with the default Snowflake JDBC driver v3.14.0.
As of November 1, 2023, Snowflake instances hosted on Google Cloud must use Snowflake JDBC driver v3.13.25 or higher. If you are using the default drivers bundled with Snowflake or ELT Snaps, your pipelines are not affected. If your Snowflake instances hosted on Google Cloud use older JARs, you must update the client drivers. Learn more.
For support of all geospatial data types, we recommend that you use our custom JDBC driver. Contact support@snaplogic.com for details.
Prerequisites
Snowflake JDBC driver JAR v3.0.0 or higher (tested and supported with the JDBC driver version 3.14.0).
For the
GEOMETRY
data type, JDBC driver JAR v3.13.28 or higher is requiredUser-defined functions (UDFs) created in the Snowflake console can be executed using Snowflake - Execute and Snowflake - Multi Execute Snaps.
In this Section
- Configuring Snowflake Accounts
- Configure Cross Account IAM Role Support for Snowflake Snaps
- Configure Security Integration in Snowflake to use in Snowflake OAuth2 Accounts
- Configure the settings for Snowflake S3 Dynamic Account
- Create Storage Integration for Google Cloud Storage
- Configure Snowflake OAuth External Authentication with Okta
- Snowflake Azure Database Account
- Snowflake Azure OAuth2 Account
- Snowflake Google Storage Database Account
- Snowflake Google Storage OAuth2 Account
- Snowflake S3 Database Account
- Snowflake S3 Dynamic Account
- Snowflake S3 OAuth2 Account
- Snowflake - Bulk Load
- Snowflake - Bulk Upsert
- Snowflake - Delete
- Snowflake - Execute
- Snowflake - Insert
- Snowflake - Lookup
- Snowflake - Multi Execute
- Snowflake SCD2
- Snowflake - Select
- Snowflake - Table List
- Snowflake - Unload
- Snowflake - Update
- Snowflake - Vector Search
- Use Case: Move Data Using Snowflake Snap Pack
Snap Pack History
Release | Snap Pack Version | Date | Type | Updates |
---|---|---|---|---|
August 2024 | main27765 | Aug 21, 2024 | Stable | Upgraded the |
May 2024 | 437patches27531 | Aug 7, 2024 | Latest | Enhanced the Snowflake - Select Snap with Time Travel query support that enables you to access historical data at any point within a defined period. This includes restoring data-related objects, duplicating and backing up data, and analyzing data usage. |
May 2024 | 437patches27156 | Jul 10, 2024 | Latest |
|
May 2024 | 437patches26821 | Jun 27, 2024 | Latest |
|
May 2024 | 437patches26508 | May 28, 2024 | Latest |
|
May 2024 | main26341 | May 8, 2024 | Stable |
|
February 2024 | 436patches25630 | Mar 28, 2024 | Latest |
|
February 2024 | main25112 | Feb 14, 2024 | Stable | Updated and certified against the current SnapLogic Platform release. |
November 2023 | 435patches24865 | Feb 5, 2024 | Latest | Fixed an issue across the Snowflake Snaps that populated all suggestions for the Schema and Table Names existing in the configured Snowflake Account. Now, the Snaps only populate suggestions related to the database configured in the Account. |
November 2023 | 435patches24110 | Dec 14, 2023 | Latest | Added a lint warning to the Snowflake-Bulk Load Snap that recommends users to select the Purge checkbox when the Data source is input view and the Staging location is External. |
November 2023 | main23721 | Nov 8, 2023 | Stable | The Snowflake Snap Pack is now bundled with the default Snowflake JDBC driver v3.14. |
August 2023 | 434patches23541 | Oct 30, 2023 | Latest | Fixed an issue with the Snowflake-Bulk Load Snap where the Snap wrote irrelevant errors to the error view when both of the following conditions occurred:
Now, the Snap writes the correct errors to the error view. |
August 2023 | main22460 | Aug 16, 2023 | Stable | The Snowflake - Execute Snap now includes a new Query type field. When Auto is selected, the Snap tries to determine the query type automatically. |
May 2023 | 433patches21890 | Jul 17, 2023 | Latest |
|
May 2023 | 433patches21370 | Jun 2, 2023 | Latest |
|
May 2023 | main21015 | May 10, 2023 | Stable |
|
February 2023 | 432patches20906 | May 9, 2023 | Latest |
|
February 2023 | 432patches20266 | Apr 3, 2023 | Latest | Fixed an issue with the Snowflake - Bulk Load Snap that resulted in lowercase (or mixed case) column names when creating a new table under specific conditions. The new Create table with uppercase column names checkbox addresses this issue. |
February 2023 | 432patches20120 | Mar 9, 2023 | Latest | The Snowflake Bulk Load, Bulk Upsert, and Unload Snaps now support expressions for the Staging location field. |
February 2023 | main19844 | Feb 9, 2023 | Stable |
|
November 2022 | 431patches19581 | Jan 20, 2023 | Latest |
|
November 2022 | 431patches19454 | Jan 12, 2023 | Latest | The Snowflake Snap Pack supports geospatial data types. As the Snowflake Snap Pack requires using our custom Snowflake JDBC driver for full support of all data types, contact support@snaplogic.com for details. |
November 2022 | 431patches19220 | Dec 8, 2022 | Latest | The Snowflake S3 OAuth2 Account now support expressions for external staging fields. |
November 2022 | 431patches19220
| Dec 8, 2022 | Latest |
|
November 2022 | main18944 | Nov 10, 2022 | Stable |
|
November 2022 | 430patches18911 | Nov 8, 2022 | Latest | Because of performance issues, all Snowflake Snaps now ignore the Cancel queued queries when pipeline is stopped or if it fails option for Manage Queued Queries, even when selected. Snaps behave as though the default Continue to execute queued queries when the Pipeline is stopped or if it fails option were selected. |
October 2022 | 430patches18781 | Oct 27, 2022 | Latest | The Snowflake Insert and Snowflake Bulk Upsert Snaps now do not fail with the The Snowflake Bulk Load Snap now works as expected when you configure On Error with SKIP_FILE_*error_percent_limit*% and set the Error Percent Limit to more than the percentage of rows with invalid data in the CSV file. |
October 2022 | 430patches18432 | Oct 13, 2022 | Latest | The Snowflake Bulk Load Snap now has a Validation Errors Type dynamic field, which provides options for displaying validation errors. You can now choose Aggregate errors per row to display a summary view of errors. |
September 2022 | 430patches17962 | Sep 19, 2022 | Latest | The Snowflake Bulk Load Snap now triggers the metadata query only once even for invalid input, thereby improving the performance of Snap. |
September 2022 | 430patches17894 | Sep 15, 2022 | Latest | The Snowflake Select Snap now works as expected when the table name is dependent on an upstream input. |
August 2022 | 430patches17748 | Sep 2, 2022 | Latest | Fixes in the Snowflake Bulk Load Snap:
|
August 2022 | 430patches17377 | Aug 25, 2022 | Latest |
|
August 2022 | main17386 | Aug 11, 2022 | Stable | The following Snowflake Accounts support Key Pair Authentication. |
4.29 Patch | 429patches16478 | Jul 21, 2022 | Latest | Fixed an issue with Snowflake - Bulk Load Snap where Snap failed with 301 status code - SnapDataException. |
4.29 Patch | 429patches16458 | Jun 27, 2022 | Latest |
|
4.29 | main15993 | May 14, 2022 | Stable | Upgraded with the latest SnapLogic Platform release. |
4.28 Patch | 428patches15236 | Apr 12, 2022 | Latest |
|
4.28 | main14627 | Feb 12, 2022 | Stable |
|
4.27 | 427patches12999 | Nov 23, 2021 | Latest | Enhanced the Snowflake SCD2 Snap to support Pipeline parameters for Natural key and Cause-historization fields. |
4.27 | main12833 | Nov 13, 2021 | Stable |
|
4.26 Patch | 426patches11469 | Sep 3, 2021 | Latest | Fixed an issue with Snowflake Insert and Snowflake Bulk Load Snaps where the schema names or database names containing underscore (_) caused the time out of Pipelines. |
4.26 | main11181 | Aug 14, 2021 | Stable |
|
4.25 | 425patches10190 | Jul 7, 2021 | Latest | Enhanced the Snowflake S3 Database and Snowflake S3 Dynamic accounts with a new field S3 AWS Token that allows you to connect to private and protected Amazon S3 buckets. |
4.25 | main9554 | May 8, 2021 | Stable | Upgraded with the latest SnapLogic Platform release. |
4.24 Patch | 424patches8905 | Apr 14, 2021 | Latest | Enhanced the Snowflake - Bulk Load Snap to allow transforming data using a new field Select Query before loading data into the Snowflake database. This option enables you to query the staged data files by either reordering the columns or loading a subset of table data from a staged file. This Snap supports CSV and JSON file formats for this data transformation. |
4.24 | main8556 | Feb 13, 2021 | Stable | Enhanced the Snowflake - Select Snap to return only the selected output fields or columns in the output schema (second output view) using the Fetch Output Fields In Schema check box. If the Output Fields field is empty all the columns are visible. |
4.23 Patch | 423patches7905 | Dec 28, 2020 | Latest | Fixed the performance issue in the Snowflake - Bulk Load Snap while using External Staging on Amazon S3. |
4.23 | main7430 | Nov 14, 2020 | Stable |
|
4.22 Patch | 422patches7246 | Nov 6, 2020 | Latest | Fixed an issue with the Snowflake Snaps that failed while displaying similar error in the Snowflake URL connection: |
4.22 Patch | 422patches6849 | Oct 16, 2020 | Latest |
|