May 2020, 4.21 Release Notes

May 2020, 4.21 Release Notes

In this article:

Important

About SnapLogic Releases

  • Per the SnapLogic Release Process, all remaining Snaplex instances across customer Orgs are upgraded to the recommended 4.21 version (master-7451 - 4.21 Patch 1) at 9 p.m. PT on June 13, 2020. If you upgraded your Snaplex to a 4.21 version prior to the auto-upgrade event, then your Snaplex version does not change. 

  • To use the new features and Snaps in the 4.21 release, ensure that your Snaplex nodes are upgraded to the recommended 4.21 patch version (master-7451 - 4.21 Patch 1).

  • This 4.21 GA release includes the patches deployed to SnapLogic after the 4.20 GA release, as listed in the 4.20 Dot Releases page. 

  • We recommend that you upgrade to the latest Chrome or Firefox browser version and clear your browser cache before logging into the SnapLogic Intelligent Integration Platform (IIP).



Java 11 Support

Starting from the 4.18 August release, SnapLogic supports Java 11 for Groundplex instances. We recommend all customers to migrate to Java 11, since Oracle no longer releases security updates for Java 8. For details, see Configuring the Java Version on Your Groundplex.


New IP Whitelisting Requirements Reminder

We remind all customers of the new IP Whitelisting requirements that have been in effect since the August 2019, 4.18 release. Ensure that your network administrators review the following:

Platform 

New Features and Enhancements

  • Insights dashboardRevamps the Insights dashboard to provide data visualization of Org-level Pipeline-execution statistics for a specific date range.




  • Task monitoring: Adds a new tab for Tasks under Dashboard that does data visualization of triggered and scheduled tasks for a selected time range. The new tab displays the number of failed and completed executions for each task type along with their details.




  • Snap auto-configuration: Enhances the suggestion capabilities of Iris to include Snap auto-configuration in Snaps with suggestible properties. Iris Expression recommends the configuration of these properties based on similar Snap settings from Pipelines that you can access. 




  • Sticky Notes in SnapLogic Designer: Introduces the ability to add notes to a Pipeline in SnapLogic Designer. This enables you to collaborate with multiple Pipeline developers or add important notes for complex Pipelines. The notes are included in the Pipeline metadata and are immediately visible to other users accessing the Pipeline.



  • Target recommendation: Enhances the Iris Expression recommendation capabilities to include Target path suggestions in Mapper Snap. Iris recommends Target paths based on exact matches between Expression and Target paths from other Pipelines in your Org. 

Known Issues

  • A Triggered Task on a Groundplex with an underlying Pipeline that contains child Pipelines might stall as the Data Validator Snap is executing in the parent Pipeline.

  • An Ultra Pipeline sometimes processes the same message twice even though the message was processed successfully during the first attempt. 

Updates to Expression Behavior

  • Starting in the 4.21 Release (May 2020), the escaping required in the replacement text of the ReplaceAll function is identical to that of the Replace function. Prior to this release, you had to use additional escaping in the replacement text with ReplaceAll to get the desired output.

  • Starting in the 4.21 Release (May 2020), the Date.parse() function returns the response text Not a Number when you enter a non-number or infinity. Prior to this release, doing either resulted in an error, even though the formatting of the string was correct.



Standard-mode Snaps

New Snaps

  • Adobe Experience Platform Snap Pack: This Snap Pack enables you to integrate with the new Adobe Experience Platform and includes the following Snaps:

    • Adobe Experience Platform File Generator: Generates an Adobe Enterprise Platform (AEP)-compatible file by restructuring upstream data to match a specific schema stored in AEP.

    • Adobe Experience Platform S3 Connector: 

      • Enhances the Snap by removing the Create New Dataset checkbox. The Snap now automatically creates a new dataset if it does not exist.

      • Retrieves data from AWS S3 and writes it into AEP.  

    • Cassandra: Extends support to Cassandra version 3.11.5.

    • Adobe Experience Platform Write: Writes data from upstream Snaps into AEP.


  • SAP S/4HANA Snap Pack: This Snap Pack supports the SAP S/4 HANA on-premise environment and includes the following Snaps:

  • ML Data Preparation: Introduces the Mask Snap that enables you to hide sensitive information in your dataset before exporting the dataset for analytics or writing the dataset to a target file.

Updated Snap Packs 

  • Adobe Experience Platform Snap Pack: Enhances the Adobe Experience Platform S3 Connector Snap by removing the Create New Dataset checkbox. The Snap now automatically creates a new dataset if it does not exist. 

  • Cassandra: Extends support to Cassandra version 3.11.5.

  • Confluent Kafka: Enhances the Kafka Consumer Snap to significantly reduce the volume of commit requests for offsets when using the record acknowledgment mode (Wait after each record), and thereby, improve performance and stability.

  • ML Data Preparation: 

    • Enhances the Match Snap to add a new field, Match all, which matches one record from the first input with multiple records in the second input. Also, enhances the Comparator field in the Snap by adding one more option, Exact, which identifies and classifies a match as either an exact match or not a match at all.

    • Enhances the Deduplicate Snap to add a new field, Group ID, which includes the Group ID for each record in the output. Also, enhances the Comparator field in the Snap by adding one more option, Exact, which identifies and classifies a match as either an exact match or not a match at all.

    • Enhances the Sample Snap by adding a second output view which displays data that is not in the first output. Also, a new algorithm type, Linear Split, which enables you to split the dataset based on the pass-through percentage.

  • NetSuite 

    • Removes the obsolete Sandbox Account check box from the NetSuite Token Account.

    • Removes the now redundant Custom WSDL URL Domain field from the NetSuite Token Account to support NetSuite's transition to automatic account-specific domain identification.

  • Oracle: Updates the Oracle Thin Account and Oracle Thin Dynamic Account, enabling them to connect via Oracle Active Data Guard (ADG).

  • SAP: Enhances the SAP Execute Snap to add a new field, Output date time as Text, which enables you to output date and time as a String data type instead of a DateTime object.

  • Script Snap Pack: Adds a new Cleanup method in the ScriptHook interface associated with the Script Snap. This method enables the Script Snap to automatically execute a clean-up once the configured script completes executing.

  • ServiceNow: Adds support for ServiceNow Madrid, New York, and Orlando versions.

  • Transform: Adds support in the Mapper Snap to display schemas with complex nesting. For example, if Snaps downstream from the Mapper Snap have custom fields that contain multiple keys, then these keys automatically display in the Mapper Snap's Target Schema dropdown list when you toggle-off Expression Builder and select the field in the Mapping Table.

Breaking Change

The HTTP header field's behavior in the SOAP Execute Snap has been changed. Specifying key alone is not sufficient. Both key and value must be provided when invoking a task. 

Known Issues

  • In some Snaps, if you leave any expression-enabled mandatory fields empty, a null pointer exception error message might display instead of the usual error message on validation.

  • Cassandra

    • The Cassandra Snap Pack does not support the following data types introduced in Apache Cassandra V3.x:

      • DateRange

      • Duration

      • Geo-spatial data types such as Point, Polygon and LineString

    • Snaps in this Snap Pack display an exception when you query a map column that has a timestamp as the key.

  • Google Big Query Snap Pack: The Snaps no longer return the affectedRowCount field with a null value for DML (data manipulation language) queries. The said field no longer exists.

  • MySQL: When MySQL Execute Snaps (MySQL - Execute and MySQL - Multi Execute) are followed by MySQL Snaps, such as MySQL - Insert, MySQL - Merge, they display the following error when executed: 
    Table definition has changed, please retry transaction.

    This happens due to a known issue in the MySql Database. For more information, see MySQL Bug #65378.

  • Parquet Writer (Behavior Change): In the 4.20 Snap version (snapsmrc535 and hadoop8776) when a value for a field defined as repeated (for example, devops in the below example) is not present in the input document, the Parquet Writer Snap displays "The required field 'devops' is missing from a document" error. However, in the 4.21 release, the Parquet Writer Snap outputs a null value when there is no input for the repeated fields. If this behavior change impacts your existing Pipelines having the Parquet Writer Snap, then you might want to consider potentially redesigning your impacted Pipelines.

    repeated group devops { required binary lan (UTF8); optional binary lan2 (UTF8); }

Custom Snaps

During the May2020, 4.21 release cycle, we did multiple enhancements to the third-party dependencies used by the SnapLogic platform and the Snaps. Hence, we strongly recommend updating and redeploying all your custom Snap Packs to ensure compatibility with this release. For details, see Updating Custom Snap Packs in the SnapLogic Developer Documentation.



Prior 4.20 Snap Dot Releases in 4.21 GA 

 The following 4.20 Snap Dot Release updates are now a part of the current 4.21 GA release.

Standard-mode Snaps

Snap Pack

Update Date

Build

Updates

Snap Pack

Update Date

Build

Updates

JMS

May 6, 2020 

jms8824

Fixes an issue in the JMS Consumer Snap due to which the Snap does not release the memory even after Pipeline termination, leading to huge memory spikes.

Workday

Apr 27, 2020 

workday8817

Fixes the Workday Write Snap that ignores the Import Synchronized check box selection while importing object data. The Snap now:

  • Waits for the current import request to complete, whether successfully or with error, before initiating the next import request.

  • Provides accurate real-time status of the request to downstream Snaps.   

Existing Pipelines using this Snap may experience longer execution times due to the synchronous behavior. However, you no longer need to use an additional Snap to capture and pass on the request status to downstream Snaps.

SOAP

Apr 27, 2020 

soap8816

Enhances the SOAP Execute Snap to allow user-specified empty fields in the SOAP request.

MySQL

Apr 22, 2020 

db/mysql8815

Fixes the MySQL Stored Procedure Snap to resolve compatibility issues with the Amazon Aurora database.

Oracle

Apr 21, 2020

db/oracle8812

Enhances the Oracle Snap Pack to support connection to the Oracle ADG (Active Data Guard) URL.

Email

Apr 21, 2020

email8813

Fixes an issue with the Email Sender Snap that caused the Snap to fail while uploading attachments to SMB locations when the attachment password contained a forward slash "/".

SAP

Apr 20, 2020 

sap8811

Updates the SAP IDoc Write Snap with the following:

  • Fixes the stack overflow error that occurs while retrying to write the IDoc to the SAP server. 

  • Adds inbound success codes to the default value which otherwise only indicates the IDoc being created.

  • Enhances the error messages for a better user experience.

JMS

Apr 20, 2020 

jms8810

Fixes the connection leak issue in the JMS Producer Snap.

SAP HANA

Apr 17, 2020 

snapsmrc535

Reverts the SAP/HANA Snap Pack to the stable version snapsmrc535.

SAP S/4HANA

Apr 17, 2020 

saps4hana8804

Introduces the SAP S/4HANA Snap Pack to support the SAP S/4 HANA Cloud and SAP S/4 HANA On-premise environments. The Snap Pack includes the following Snaps:

Oracle

Apr 16, 2020 

db/oracle8803

Support for Oracle Database 19c.

Binary

Apr 15, 2020 

binary8801

  • Fixes the Decompress Snap wherein the Snap stops decompressing at 64MB without displaying any error, when decompressing using the GZIP scheme.

  • Fixes an issue in the PGP Encrypt Snap so that third-party decryption tools do not receive a .tmp file from the Snap. 

Snowflake

Apr 14, 2020 

db/snowflake8800

Certifies the Snowflake Snap Pack against JDBC Driver version 3.12.3.

Snowflake Execute and Multi-Execute Snaps may break existing Pipelines if the JDBC Driver is updated to a newer version.

With the updated JDBC driver (version 3.12.3), the Snowflake Execute and Multi-Execute Snaps' output displays a Status of "-1" instead of "0" without the Message field upon successfully executing DDL statements. If your Pipelines use these Snaps and downstream Snaps use the Status field's value from these, you must modify the downstream Snaps to proceed on a status value of -1 instead of 0.

This change in the Snap behavior follows from the change introduced in the Snowflake JDBC driver in version 3.8.1:
"Statement.getUpdateCount() and PreparedStatement.getUpdateCount() return the number of rows updated by DML statements. For all other types of statements, including queries, they return -1."

REST

Apr 13, 2020 

rest8798

Fixes the REST POST Snap that fails when a single file is uploaded in multi-part form using the Single file upload Snap settings.

NetSuite

Apr 13, 2020 

netsuite8799

Updates the NetSuite Create, Update, Upsert, and Async Upsert Snaps to use the Classification type instead of Class, to resolve schema generation issues. While the Class type remains available in the NetSuite Search and Async Search Snaps for backwards compatibility, use of the Classification type is recommended.

Salesforce

Apr 13, 2020 

salesforce8797

Fixes the Salesforce Subscriber Snap wherein the Salesforce Subscriber and Mapper Snap combination generates Null output for Array object type.

SQL Server

Apr 7, 2020 

db/sqlserver8793

Fixes an issue in the SQL Server - Insert Snap due to which the Snap failed to load values of data type INT.

SQL Server

Apr 10, 2020 

db/sqlserver8796

Fixes the SQL Server - Bulk Load Snap to mask the password in the logged exception messages

Transform

Apr 6, 2020 

transform8792

Resolves the NoClassDefFoundError in the Join Snap on Windows Snaplex instances.

Binary

Apr 2, 2020 

binary8791

Fixes the ZipFile Write Snap wherein the Snap fails to execute if it finds different zip file paths when processing multiple input binary data.

Active Directory

Apr 2, 2020 

activedirectory8789

Fixes the Active Directory Snaps to successfully read special characters in the Existing distinguished name and Distinguished name Snap settings without requiring escape characters.

Transform

Apr 1, 2020 

transform8788

Resolves the NullPointerException in the Join Snap on Windows Snaplex instances.

Binary

Mar 30, 2020 

binary8785

  • Adds the User-defined object metadata and Object tags properties in the S3 File Writer Snap and the Get Object Tags property in the S3 File Reader Snap to allow inclusion of user defined metadata and object tags.

  • Fixes a regression caused by Patch binary8775 wherein the File Reader and S3 File Reader Snaps fail to read S3 files with an account which does not include GetObjectTagging permission.