Support for creating APIs from Swagger 2.0 specifications
Support for API versioning
ELT for Cloud Data Platforms:
New! Launching Fast Data Loader
Introducing two new Snaps -- ELT Execute and ELT SCD2
Support for Snowflake that is hosted on Azure or Google Cloud Platform (GCP)
Support for ELT operations on data from Google Cloud Storage into Snowflake
Automatic download of JDBC Drivers for Snowflake, Redshift, and Azure Synapse
Support for additional Window functions: Covariance, Correlation, and Linear Regression Functions
New Snaps:
Twilio Snap Pack
NetSuite Call RESTlet Snap
SAP RFC Listener Snap
Per the SnapLogic Release Process, all remaining Snaplex instances across Orgs are auto-upgraded to the main-9727 - Patch 1 versionat 9 p.m. PT on June 12, 2021. Orgs migrated to the 4.25 GA version prior to the auto-upgrade are not impacted.
To use the new SnapLogic features and Snaps in the 4.25 release, ensure that your Snaplex nodes are upgraded to the recommended version.
This 4.25 release includes the patches deployed to SnapLogic after the 4.24 release, as listed in the 4.24 Dot Releases section.
Fixed an issue where Tasks with the + symbol in their names did not complete execution when activated.
Fixed an issue where service directory errors caused log files to increase in size.
Fixed an issue where memory usage for a Snaplex node increased despite a lack of Pipeline activity, unless restarted.
Fixed an issue where some Groundplex nodes experienced unexpectedly high CPU utilization.
Fixed an issue where Scheduled Tasks were not scheduled correctly because of daylight savings time.
Fixed an issue where some OAuth 2.0 endpoints did not support additional properties sent in the client body with credentials.
N/A
Control Plane update:
Fixed an issue where the public API for Pipeline runtime collection returned less runtimes than expected.
Fixed an issue where Task notifications were not taking effect despite being created successfully.
Fixed an issue in Designer where suggested Snaps for ELT Pipelines included standard-mode Snaps, even though they are not supported.
main-9825 - 4.25 Patch 2 (Restricted)
This is a restricted Snaplex build. For more information, contactsupport@snaplogic.com.
main-9727 - Patch 1
Fixed an issue where some recurring Scheduled Tasks caused duplicate Pipeline executions.
Fixed an issue where the Do not start a new execution if one is already active option in Scheduled Tasks was not enabled.
Fixed an issue with the OAuth 2.0 implementation for some Snap accounts by adding support to send client credentials as a Basic Auth header.
Fixed an issue with Snaps that allocate Snap metrics, where over time a memory leak occurred, requiring the reboot of the Snaplex node associated with the Pipeline.
N/A
Control Plane update:
Fixed a caching issue with the UI.
Fixed an issue with the Project Migration API by restoring the original functionality of the duplicate_check parameter.
Fixed an issue where after overwriting a file in SnapLogic Manager successfully, the changes were not reflected in the actual file and the data remains unchanged when the file was reopened.
UI
Date of Update
Update
Fixed an issue where opening the document preview for the second input of an Open API Snap caused the UI to freeze.
Fixed an issue where Pipeline Parameters were not displayed in the dialog window for new Triggered Tasks.
Fixed an issue with account validation where the Snaplex dropdown list Manager was empty when the Project Space or project name had special characters that required encoding.
Fixed an issue on the Create API form where re-uploading an API specification and clicking Cancel causes an unexpected error message.
Fixed an issue where the Task dialog window did not display the When Task Has options if you entered recipients in the Slack Notification field but left the Email Recipients field empty.
Fixed an issue where the Version Details page in the new API Manager console did not indicate on which server the API version was deployed.
Fixed an issue with the Dashboard > Snaplex tab where after selecting a Snaplex, all graphs displayed data for a week instead of the default time period (one hour).
Fixed an issue where the Triggered Task Details page did not display the Download the CA certificate option.
Fixed an issue where a Snap in the New Form UI did not display the default value for a new field in the Settings dialog window.
Fixed an issue where settings and recipients entered in the Task execution duration - time limit notification would not be recorded after reopening the completed notification.
Fixed an issue where the Mapper Snap Settings dialog window displayed the Missing property value error message twice after you deleted an existing expressions field.
Fixed an issue where the red arrow error indication was displayed in the password complexity tooltip.f
Fixed an issue with eXtreme Pipelines where the Disable Snap option (which did not function) was removed from the Snap Settings dialog window.
Fixed an issue where copying and pasting a Snap with a mouse caused an error, even after clearing the browser cache.
Fixed an issue where in some account types the Create Account dialog window did not display the username for the account.
Fixed an issue with the Select a Snaplex for validation dialog window where the Snaplex dropdown list displayed only Snaplex instances from the global shared folder.
Modified default valuesfor the following fields in Box Read and Box Write Snaps:
Number of Retries - Changed from 3 to 0.
Retry Interval (seconds) - Changed from 5 to 1.
For existing Pipelines which have the Enable Staging (deprecated field) checkbox selected, this Snap retries the connection once even if the Number of Retries is zero.
Updated the AWS SDK from version 1.11.688 to 1.11.1010 in the DynamoDB Snap Pack and added a custom SnapLogic User Agent header value.
Enhanced the performance of Binary Router Snap through an efficient IO utilization.
Enhanced the JIRA Snap Pack to support HTTP proxy authentication.
Updated the error output view of the OneDrive - Upload File Snap from a Binary view to a Document view.
Improved the error messages in the Teams - Create Team Snap where the Snap fails with a null pointer exception errorwhen the given account information is invalid.
Enhanced the Directory Browser Snap to process files with the owner field for the SFTP protocol. Upon validation, the output of the Snap fetches the owner’s name, which was previously displayed as unknown.
Fixed an issue with theFile WriterSnap where the Snap fails to connect to the SFTP endpoint using the AWS Transfer Family.
Fixed an issue where Pipelines fail to connect the SFTP Server with theBinary Snap Pack after upgrading to the SnapLogic 4.25 release version (main9554).
Enhanced theCoupa Snap Pack to support HTTP proxy authentication.
Improved the Exchange Online Snap Pack to handle authentication token errors and acquire new tokens and improved the error messages in the Create Event Snap where the Snap fails with a null pointer exception errorwhen the given account information is invalid.
Fixed an issue with the Deduplicate Snap where the Snap breaks when running on a locale that does not format decimals with Period (.) character.
Improved the error messages in the Channel Operations Snap where the Snap fails with a null pointer exception errorwhen the given account information is invalid.
Enhanced the SOAP Snap Pack to support HTTP proxy authentication.
Fixed an issue with Tableau REST Snap where the Snap was not able to filter or route the output data shows either duplicate records or incorrect results.
Fixed an issue with the Generic JDBC - Select Snap where if there are URL properties in the account, the unPooledConnection does not use the properties when creating a connection. This causes the auto-detect functionality to use the wrong database name.
Fixed an issue with MySQL and MariaDB in the Generic JDBC - Update Snap when a table is incorrectly reported as not being found.
Enhanced the MySQL - Lookup Snap suggestions to load the Output Fields and Lookup Column settings.
Fixed an issue with the MySQL - Select Snap where the second output view of the Snap was showing empty column values and improved error messages in the Snap where the Snap fails with a null pointer exception error when the given account information is invalid.
Improved the support for the CLOB data type in the Oracle - Insert Snap.
Improved the error messages for all the Snaps in the OracleSnap Pack where the Snaps fail with a null pointer exception errorwhen the given account information is invalid.
Updated the AWS SDK from version 1.11.688 to 1.11.1010 in the Redshift Snap Pack and added a custom SnapLogic User Agent header value.
Improved the error messages for all the Snaps in the Teradata Snap Pack where the Snaps fail with a null pointer exception errorwhen the given account information is invalid.
Enhanced the Create Entry and Update Entry Snaps to support Pipeline parameters and upstream values for the Attribute name setting under Attributes and the Snap Pack to support proxy authentication.
Fixed an issue with the Salesforce Read Snap where the retry fields do not work as expected when a Pipeline has more than ten Snaps and improved the error messages in the Snap where it fails with a null pointer exception errorwhen the account reference provided is invalid.
Fixed an issue in the CSV Formatter Snap where even if the Ignore empty stream checkbox is not enabled, the Snap did not produce an empty binary stream output in case there is no input document.
Enhanced the CSV Parser Snap with a new checkbox PreserveSurrounding Spaces that enables you to preserve the surrounding spacesfor the values that are non-quoted.
Replaced the Strict XSD output field with Map input to first repeating element in XSD field in the XML Formatter Snap. If selected, the Snap ignores the root element from the XSD file.
Enhanced the SOAP Execute Snap with a new checkbox Escape special charactersthat enable the snap to escapeXML special charactersin XML template variable values when this Snap inserts these values into theApache Velocitytemplate.
Enhanced the Snowflake S3 Database and Snowflake S3 Dynamic accounts with a new fieldS3 AWS Token that allows you to connect to private and protected Amazon S3 buckets.
Improved the handling of interrupted/aborted Kafka Snaps to ensure proper clean-up of metrics.
Optimized the Kafka Producer Snap to initialize the Kafka API only if there is at least one input document.
Fixed an issue of account passwords being included in the log messages output of Kafka Snaps. The password is now hidden in the logs for both Kafka Consumer and Kafka Producer Snaps.
Enhanced the Kafka Producer Snap to support Avro serialization format with a new target data type Avro under Key and ValueSerializer.
Enhanced the Kafka SSL Account with new fields (Registry Username or Key and Registry Password or Secret) for Schema Registry authentication. The two existing SASL properties (SASL Username and SASL Password) have been revised to SASL Usernameor Key and SASL Password orSecret, respectively.
The Kafka Producer and Consumer Snaps create a default client ID string to identify the specific Snap instance.
Apache Kafka client library is upgraded from version 2.6.0 to 2.8.0.
Confluent Kafka client libraries are upgraded from version 5.2.1 to 6.2.0.
Enhanced the Salesforce Read Snap to allow you to add an optional second output view that exposes the schema of the target object as the output document. The output view of the Snap has a minimum of one output and a maximum of two outputs.
Fixed the following issues in the PGP Decrypt Snap caused due to the Snap patch 425patches9581:
The Snap writes an empty document to the output view when there is an error in the Snap. It will now decrypt the document and write it to the output view only if it succeeds.
The Snap fails to decrypt any non-signed encrypted file more than 500 bytes. It will now decrypt both non-signed and signed encrypted files.
Removed the Project ID field from the Google Service Account in the Binary Snap Pack, since the JSON Key already contains information about the Project ID.
Fixed an error in the Dynamics 365 for Sales Create Snap where the Snap does not send the original documents to the error view in the output when the batch size property is set to greater than 1.
Enhanced the ServiceNow QuerySnap with the retry mechanism that includes the following settings:
Number of retries:Specifies the number of attempts the Snap should make to perform the selected operation in case of a connection failure or a timeout.
Retry interval (seconds): Specifies the minimum number of seconds the Snap must wait before each retry attempt.
Modified default values of the following fields across the Box Snap Pack to trigger automatic retries by default, in case of connection failures or timeouts:
Fixed a dependency issue inHadoop Parquet ReaderSnap while reading data from the AWS S3 folder. The issue is caused due to conflicting definitions for some of the AWS class dependencies in the classpath.
Enhanced the performance of PostgreSQL - Bulk LoadSnap significantly. We expect the Snap to execute up to 3 times faster than the previous version for enterprise workloads.
Fixed a ClassCastException error in the Avro Parser Snap and handling of themap, fixed, enum, and bytes data types in theAvro Formatter and Avro Parser Snaps.
Fixed an issue with the PGP Decrypt Snap where the Snap writes an empty document to the output view when there is an error in the Snap. It will now decrypt the document and write it to the output view only if it succeeds.
As of we have discovered an issue with this Binary patch affecting the PGP Decrypt Snap. In case your Pipelines use the PGP Decrypt Snap, we recommend you to NOT use this patch. Else, your Pipelines will likely fail. We're working on a fix and will be deploying a Snap patch soon.
Fixed the REST Post Snap that fails to correctly set the Content-Length header when working with multi-file uploads.
Added Send Client Data as Basic Auth Header check box to the Create Account settings of the OAuth2 and OAuth2 SSL accounts. This check box enables you to includeand pass the client credentials information in the header when connecting to the OAuthendpoint.
Reverted the Join Snap to the 4.24 release behavior. This is in response to an issue encountered in the Join Snap in the 4.25 release version (main9554) that can result in incorrect outputs from all Join Types. 425patches9638 is the default version for both stable and latest Transform Snap Pack versions for orgs that are on the 4.25 release version. No action is required by customers to receive this update and no impact is anticipated. For more information, contact support@snaplogic.com.
Updated the ELT SCD2 Snap to replace End date of historical row option in the Meaning field of Target Table SCD2 Fields field set with End Date of Current Row.
This may cause the existing Pipelines to fail as the End date of historical row option no longer exists.
You need to make the following update in the ELT SCD2 Snap's settings across your Pipelines after upgrading your Snap Pack to this patch version:
Select End Date of Current Row from the Meaning drop-down list in the second entry (highlighted in the image).
Fixed the issue with the ELT Insert-Select Snap containing an open output preview that fails to retrieve output preview data in case of Redshift and Azure Synapse databases, though the Pipeline runs work as expected.
Fixed an issue where the ELT Execute Snap does not error out (Snap turns Green) even when running an SQL query to drop a non-existent table from a Snowflake or Azure Synapse database.
[Update on ]: Enhanced the ELT Snap previews to support the following data types: array, object, variant, and timestamp.
The Snaps convert the values to hexadecimal (HEX) equivalents—the default setting for the session parameter BINARY_OUTPUT_FORMAT in Snowflake. See Session Parameters for Binary Values for more information.
If this setting is different from hexadecimal (such as base64) in the Snowflake table, the Snaps still convert the values to hexadecimal equivalents for rendering them in the Snap previews.
Enhanced the ELT Snap preview to display the exact binary and varbinary values from the Snowflake database during Pipeline validation, by converting the values to hexadecimal equivalents—the default setting in Snowflake. If the setting is different from hexadecimal in the Snowflake table, then the Snaps still convert the values to hexadecimal for rendering the Snap preview.
Enhanced the ELT Transform Snap to display the appropriate data type (binary or varbinary) for the column names populated in the output schema.
Enhanced the ELT Window Functions Snap to address potential issues due to an incorrect definition for MINUS function in the case of Redshift and Azure Synapse databases.
4.25 UAT Delta
This section tracks the changes made during the iterative pushes to the UAT server and the GA release. The following is the release schedule:
UAT 1: Friday, April 23, 2021 – Snaplex version: 4.25_rc-9551 - 4.25 GA (Recommended)
The SnapLogic GA release build on the production server is also deployed on the UAT server.
UAT 2 Fixes
Platform
Design-first API Management:
Fixed an issue with the API specification that fails to import while updating a Pipeline.
Fixed an issue where a user with full access to the SnapLogic Platform is unable to create an API.
UI
Fixed an issue with the new Task dialog window where you cannot assign another Snaplex to the task when the original Snaplex is deleted.
Fixed an issue with Scheduled Tasks in Manager that opens the Task Update dialog in the old UI, instead of the new UI.
Snaps
Fixed the Salesforce Subscriber Snap that fails when used with an HTTP Proxy, displaying a javax.net.ssl.SSLHandshakeException error.
Platform
The Snaplex-based Scheduler will be the default scheduling mechanism for all Scheduled Tasks in the 4.26 release (August 2021). The new scheduling mechanism improves the timeliness and reliability of Scheduled Task executions, and we recommend that you enable the Snaplex-based Scheduler on your Orgs.
New Features
API Management - Design-First: Introduced an API Management section in Manager where you can create an API based on an Open API Specification (OAS) 2.0. As an Org admin, you can also manage APIs in the new API Manager console. The API Manager - /apim space supports the following activities:
Create an API by uploading a Swagger 2.0 specification or by referencing it through a URL.
Support for elastic scaling in Kubernetes: Introduced autoscaling for your Snaplex instances that are running in a Kubernetes environment. This implementation replaces the previous Kubernetes-based deployment of a Snaplex. Starting with the 4.25 release (May 2021), you can set up your Snaplex helm chart to initiate the scaling up and down of your node resources through Kubernetes orchestration. This implementation requires the Prometheus adapter and Grafana analytics.
Anomaly detection and active Pipeline analysis: Introduced two alert notifications for tracking Task executions that take a longer time than usual. You can define a hard limit either in minutes or by the percentage based on the last 30-day historical executions.
Enhanced memory and resource management to limit memory growth on Snaplex nodes. If the memory usage exceeds 95% of the configured maximum heap limit, the Pipelines that are causing the high memory utilization are terminated to prevent the Snaplex node from failingwith an OutOfMemory error.
Enhancements to Existing Features
Snaplex monitoring: Added support for granularity in the reporting of data spikes in your Pipeline executions in the widgets on the Snaplex Dashboard Wall. You can now select Pipelines within a 15-minute window (indicated by the vertical line) and correlate active Pipelines with high resource utilization.
Asset Palette for APIs: Support for searching for Pipelines that are used by APIs that are created in the new API Management console.
Progressive loading of the Asset tree in Manager: Enhanced the search-and-browse experience in Manager. The assets are retrieved as needed, thus reducing latency.
UI refresh of Task dialog windows: Redesigned dialog windows for Triggered, Ultra, and Scheduled Tasks, giving the displays the same appearance as that of theNew Form UI. As an enhancement, you can now select the Task type when opening the dialog window from Designer.
UI refresh of the Account dialog windows: Updated the UI and enhanced the support for creating accounts in Manager. Previously, in the 4.24 release and earlier, the option to create or modify an account using the New Form UI was available only in Designer.
Known Issues
When you migrate a project more than once, the existing assets are overwritten. You might have to associate your Tasks with the correct Pipelines after the migration. Typically, even after multiple migrations, account references remain intact in the Pipeline, but we recommend that you verify all references before starting your Pipeline executions. This behavior is a result of the duplicate_flag parameter being disabled.
When a start time of a Scheduled Task using the Snaplex-based scheduler is modified, the configured start time is not used to trigger the Pipeline execution.
In some scenarios with the Snaplex-based Scheduler, multiple executions of a Scheduled Task occur when only one instance is set to execute.
When calling a child Pipeline from a Groundplex to Cloudplex or vice versa, the Pipeline Execute Snap hangs, causing the parent Pipeline not to complete the execution.
The New Form UI does not show the default value for a custom property when editing an existing instance of a Snap.
In Manager, the Task Details page for some Triggered Tasks does not display the Download CA Certificate option.
When creating iterative Scheduled Tasks in time zone regions that have Daylight Savings, we recommend that you select the Cron Job option. See best practices for details.
Behavior Change
Retired the legacy UI: The legacy UI for Snaps is retired. Starting in the 4.25 release (May 2021), the option to deselect the New Form UI in the User Settings dialog window is no longer available. All Snaps can be viewed only in the new UI.
Standard-mode Snaps
New Snaps
NetSuite Call RESTlet: This Snap provides the functionality of the NetSuite RESTlet framework that supports the HTTP methods (GET, DELETE, POST, PUT) and MIME types. You cancall RESTlet scripts through token-based authentication.
SAP RFC Listener:This Snap facilitates Remote Function Calls (RFCs) between two SAP systems. The Snap simulates an RFC server and listens to the incoming RFC calls infinitely. Subsequently, the Snap generates output documents from the import parameters or triggers a child Pipeline.Business applications can use the RFC mechanism to communicate and exchange information (in predefined formats) with other systems.
Twilio Snap Pack: This Snap Pack enables you to perform various communication functionsprogrammatically, such as making phone calls and sending text messages using Twilio's Web Service APIs. This Snap Pack has the following Snaps:
Twilio Read Snap: Retrieves data resources from Twilio's REST APIs.
Enhanced the Binary Snap Pack by adding an accountTwo-Factor Auth Account that supports two layers of authentication for Secure File Transfer Protocol (SFTP). The two secure layers of verification to grant access include the Basic Auth (username/password) and the SSH Key (username/private key) methods.
Enhanced the S3 File Writer Snap with the following abilities:
Use an MD5 checksum that checks for data integrity and corruption while uploading the file.
Write S3 objects with Access Control List (ACL) details in a single API call.
Behavior Change
In the 4.23 release, the S3 File WriterSnap used to write an S3 file and then set ACL if the ACL property was not empty. If the file write was successful and the ACL setting failed, both the output document in the output view and the error document in the error view was displayed. This issue has been resolved in the 4.24 release by enabling the Snap to configure ACL while writing the file. Therefore, the Snap produces an error document in the error view if the ACL configuration fails, irrespective of whether the file write action passes or fails.
Enhanced the Snaps in this Snap Pack with the Retry mechanism that includes the following settings:
Number of retries: Specifies the number of attempts the snap should make to perform the selected operation in case of connection failure or timeout.
Retry interval (seconds): Specifies the minimum number of seconds the Snap must wait before each retry attempt.
Enhanced the output view of the Box Directory Browser Snap to display the error message,Error retrieving contents of the folder with id:<Folder ID> instead of No folder exists with <Folder ID> when you enter an invalid folder ID.
DynamoDB Snap Pack: Enhanced the DynamoDB Account to support the Expression Enabler for account properties and creation of dynamic accounts.
Number of Retries: Specifies the maximum number of retry attempts when the Snap fails to connect to the Hadoop server.
Retry Interval (seconds): Specifies the minimum number of seconds the Snap must wait before each retry attempt.
Microsoft OneDrive Snap Pack: Enhanced the Update Share Permissions Snap with the Share Type and Expires fields that enable you to update the share permissions on your OneDrive items shared using the Invite or Link option. If the Share type is link, you can specify the expiry date and time for the URL that is used to share permissions.
Microsoft Power BI Snap Pack: Enhanced the following Snaps in the Microsoft Power BI Snap Packby supporting data flows with two options, Dataflow and Dataflow Storage Accounts.
Enhanced the pass-through behavior in Bulk API mode for Salesforce Write Snaps to include the input document in the original key when the batch size is set to 1. When the batch size is greater than 1, the input document is not included in the original key. This enhancement impacts the following Snaps:
Enhanced the Salesforce Upsert Snap to support CSV payload using the new field Bulk Content Type in Bulk API mode. The Salesforce API has recently introduced support for CSV payloads. In the 4.24 release and earlier, this Snap supported only the XML data type; starting from the 4.25 release, you can select CSV as the Bulk Content Type drop-down list. The default content type is set to XML to support backward compatibility. This enhancement also addresses the null values issue in Bulk API mode.
Enhanced the Snaps in the Salesforce Snap Pack by updating the field labels to the title case. If you have existing Pipelines that use Salesforce Snaps that include the field names in error messages, you must update those Pipelines to use the new field labels.
Enhanced the Snowflake - Bulk Load Snap toenable datatransformation using the new field Select Query before loading data into the Snowflake database.This option enables you to query the staged data files by either reordering the columns or loading a subset of table data from a staged file. It also enables you to transform data types. This Snap supports CSV and JSON file formats for data transformation.
Memory Sensitivity: The Snap's response to the memory changes.
Group Size: The maximum number of input documents to be grouped into a single output document.
Min Group Size: The minimum number of input documents to be grouped into a single output document.
Flush Timeout: The number of seconds the Snap must wait before processing the records even if the incoming messages do not reach the specified Group Size.
Known Issues
The Generic JDBC - Insert Snap in the JDBC Snap Pack might fail due to a connection issue. We recommend that you roll back to the main8614 version.
The Avro Parser Snap in the Transform Snap Pack might fail due to ClassCastException error. We recommend that you upgrade to the 425patches9815 version.
Prior 4.24 Snap Dot Releases that are Merged into 4.25 GA
Data Automation
SnapLogic's data automation solution speeds up the identification and integration of new data sources, and the migration of data from legacy systems. The solution can automatically detect duplicate, erroneous, or missing data, and identify structures and formats that do not match the data model. Data automation can accelerate the loading and transformation of your data into the data warehouse, speeding up the data-to-decisions process.
New Features in ELT Snap Pack
Starting with the 4.25 release, SnapLogic has now certified the ELT Snap Packto work with Snowflake hosted onGoogle Cloud Platform (GCP) as the target database, in addition to the other flavors of Snowflake hosted on AWS and Microsoft Azure.
Introduced the ELT Execute (Archived) Snap to enable you to run DML, DDL, and DCL SQL queries in Snowflake in Snowflake, Redshift, and Azure Synapse.
Introduced the ELT SCD2 Snap to support Type 2 Slowly Changing Dimensions (SCD2) updates to the target databases—Snowflake, Redshift, and Azure Synapse.
Support for Google Cloud Storage as a storage location (source) in addition to AWS S3 and Azure Data Lake Storage (ADLS) when your target database is Snowflake.
Automatic download of the JDBC driver required for the selected Database Typeusing the new Download JDBC Driver Automatically check box.
Supported JDBC JAR Versions
ELT Snaps automatically use a corresponding JDBC JAR file to connect to your target database and to perform the load and transform operations.
Database
Certified JDBC JAR File
Azure Synapse
mssql-jdbc-9.2.1.jre8.jar
Redshift
redshift-jdbc42-2.0.0.2.jar
Snowflake
snowflake-jdbc-3.13.1.jar
Though we recommend you to use the above JAR file versions, you can choose to use a different version, based on your environment.
Updated ELT Snaps
Enhanced the ELT LoadSnap to prevent changes to existing tables during Pipeline validation. If you set the Load Action as Drop and Create table, and the target table does not exist, the Snap creates a new (empty) target table based on the schema specified in its settings.
Enhanced the ELT Window Functions Snap to support Covariance, Correlation, and LinearRegression Functions on Snowflake, Redshift, and Azure Synapse databases. The Snap uses function-specific query re-writes to support these functions on Redshift and Azure Synapse databases.
Enhanced the ELT Merge Into and ELT Insert-Select Snaps to support up to one output view, and added the Get Preview Data check box to these Snaps. You can now connect downstream ELT Snaps to these Snaps.
Updated eXtreme Snap Packs
Introduced the SCD2 - Spark SQL 2.x Snap to support Type 2 Slowly Changing Dimensions (SCD2) updates to the target databases in the eXtreme mode.
Upgraded the /wiki/spaces/SD/pages/410189849to support Spark 3.0.1 on the following cloud platform versions. Ensure that you update your Snaplex to 4.25 GA before running your existing eXtreme Pipelines.
Amazon EMR 6.2.0 (Hadoop distribution: Amazon)
Azure Databricks 7.5
Known Issues
When ELT and Spark SQL 2.x Snap account credentials—such as user names, passwords, client secrets, auth codes and tokens, secret keys, and keystores—are auto-filled using the Google Chrome browser, the accounts, and hence the Pipelines fail. This is because the browser overwrites the field values with its own encrypted values that the SnapLogic Platform cannot read. SnapLogic recommends that you do not auto-save your Snap account credentials in the Chrome browser. Ensure that you delete any credentials that the browser has already saved forelastic.snaplogic.com, and then perform ONE of the following actions:
Option 1: Click that appears in the address bar after you submit your login credentials atelastic.snaplogic.com, and then click Never.
Option 2: Disable theOffer to save Passwordsoption at chrome://settings/passwords while working with your SnapLogic Pipelines. If you disable this option, your Chrome browser will not remember your passwords on any other website.
For Redshift and Azure Synapse databases, the ELT Load Snap displays JSON values for fields with datatypes Date and Time when validating the Pipeline.
Snowflake
Redshift
Azure Synapse
”time_data” : “09:23:56”,
”time_data” : {“time”: “09:23:56”},
”time_data” : {“time”: “09:23:56”},
”date_data” : “2020-12-20”,
”date_data” : “2020-12-20”,
”date_data” : {“date”: “2020-12-20”},
However, the ELT Load Snap outputs the correct date and time values when executing the Pipeline.
To prevent these values from showing up in JSON format in the previews and ELT Transform Snap, you can cast the time or date values to a VARCHAR type in your custom query as follows: CAST (<time_column_type_name> AS VARCHAR(<size_based_on_precision_required>)). Example: CAST (time_data AS VARCHAR(20)).
ELT Transform Snap displays incorrect data types (string instead of the actual data type) for column names populated in its Input schema section.
New! Introducing Fast Data Loader (FDL)
Ideal for business/data analysts, FDL is a data ingestion tool that simplifies the tasks of replicating and synchronizing data from the following source endpoints:
Coupa
SQL Server
Oracle
Salesforce
ServiceNow
Weather (pre-configured endpoint)
Covid (pre-configured endpoint)
You can integrate your data source with the following destination data warehouses: