/
November 2019, 4.19 Release Notes

November 2019, 4.19 Release Notes

In this article:

  • Per the SnapLogic Release Process, all Snaplex instances across Orgs are upgraded to the 4.19 build (master-6309 - 4.19 Patch 1) at 9 p.m. PT on December 14, 2019.
  • This release also includes the patches made to SnapLogic after the 4.18 GA release, as listed in the 4.18 Dot Releases page. 
  • We recommend that you upgrade to the latest Chrome or Firefox browser version and clear your browser cache before logging into the SnapLogic Intelligent Integration Platform (IIP).

Platform Enhancements

General

  • Kubernetes Support: You can now deploy your Snaplex instances in a Kubernetes environment using Helm Charts. This support enables you to benefit from containerized technology through the resource efficiency and automated operations that Kubernetes container-orchestration system provides.

  • Scheduled Task Notifications: Improving the mechanism for triggering email notifications when an error occurs in Scheduled Tasks. Previously, even if you configured a notification, Scheduled Task failures did not trigger email notifications under all failure conditions. With this release, you might see an increase in failure notifications because of this improvement. For example, if permissions are modified after a Scheduled Task is set up, then the Pipeline called by the Task can no longer execute, triggering an email notification.

  • Modifying Shared Objects: Enhancing Pipelines Executions Statistics to display a warning message when you attempt to modify an object shared between multiple documents. Sharing primarily occurs with the $original object when a Snap outputs multiple documents for a single input. For example, an SQL Select Snap that matches multiple rows for a single input document produces documents where, for each entry, $original refers to the same object. With this release, if you follow that SQL Select Snap with a Mapper Snap that writes to a property in $original, a warning message appears in the Execution Statistics window. Since modifying a shared object can lead to inconsistent results, you must copy the object. 

    Benefit to Sharing $original Objects

    The $original objects are shared for performance reasons. Copying them for every output document can be resource intensive.

  • Ensuring Backward Compatibility with JDK 9 and Upwards: If your Snaplex is using JDK 8u181 or higher, your existing Active Directory Pipelines are likely to break with a Failed to validate account error. This is because Java's Improved LDAP Support security enhancement enables endpoint identification on LDAPS connections by default.

    Workaround:

    Set the JVM option com.sun.jndi.ldap.object.disableEndpointIdentification to true in your Snaplex's node properties (Global properties). This disables endpoint identification. You may have to contact your SnapLogic Organization Admin to include this setting. 

API Management Enhancements

Enhancing the SnapLogic API Management with the following API proxy features:

  • Request Size Limiting: Support for blocking API requests that attempt to pass a payload size beyond a specified limit. Such requests can affect critical backend systems. This policy enables you to restrict the payload size in the API response. 

  • Update Proxies: Support for editing the following configuration properties in a Proxy:
    • Modify Policies
    • Modify the APIs included in the Proxy

The update functionality makes it easier for you to modify the endpoints and policies in your Proxies while retaining the same Proxy name. Previously, to update a Proxy, you would have had to create a new Proxy with a different name.

Reminder

New IP Whitelisting Requirements

We remind all customers of the new IP Whitelisting requirements that are in effect beginning with the 4.18 August 2019 release. Ensure that your system administrators of Snaplex instances and networks review the following:

Upgrading Your Groundplex to Java 11

Starting from the 4.18 August release, SnapLogic supports Java 11 for Groundplex instances. We recommend all customers to migrate to Java 11, since Oracle no longer releases security updates for Java 8. 

Java 11 support highlights

  • Starting from the 4.18 release, Snaplex Linux installers are bundled with the Java 11 distribution, which includes the Java Runtime Engine (JRE 11).
  • The 4.18 release supports Java 8, and so will the 4.19 release.
  • Current Groundplex installations will continue to work with Java 8 until the Snaplex is reinstalled using the new installer. 
  • All Groundplex instances prior to the 4.18 release must reinstall the Groundplex using the new installer. 
  • The new Groundplex installs with Java 11; however, the current default version is Java 8.
  • Support for Java 8 version will cease with the SnapLogic 4.20 release. 

For details, see Upgrading Your Groundplex to Java 11.

Known Issues

Previous Dot Releases in 4.19 - Platform

The following 4.18 Platform Dot Release updates are now a part of the 4.19 release:

Update DateBuildUpdates
  master-6135 - 4.18 Patch 4 Fixes an issue that causes the parent Pipeline to not include the correct error message when its child Pipeline, which has a Pipeline Execute Snap, fails.
 
master-5912 - 4.18 Patch 3 (Recommended) 
  • Fixes an issue with error handling, where child Pipelines with Pipeline Execute Snaps fail.
  • Fixes an error encountered while loading error Pipelines that use dynamic expressions.
  • Fixes an issue with Pipeline execution stalling when child Pipeline uses binary views.
  • Data lineage information is now throttled to prevent growth in runtime data size that may cause some Pipelines to fail.
  • Optimizes loading metadata from control plane by using compression.


UI Enhancements

Designer

  • New UI Form: Introducing a new UI form as an opt-in feature for Snap configuration. Besides a new look, the new UI form offers an improved user experience and reduced latency. To enable the new UI form, select the New Form UI checkbox on the User Settings menu in SnapLogic Designer. Additionally, in the Mapper Snap integrates the AutoLink feature (formerly, SmartLink) in the same Infobox popup.

Adding an Account in the current Snap form

Adding an Account with the new Snap form (when enabled in the User Settings dialog)

  • Data Preview: Enhancing the Data Preview feature with the addition of the Formatted checkbox. This functionality enables you to format document data with line-feeds that would otherwise be ignored, and increase the readability of this data in table/JSON modes. When viewing error documents that have a stack trace column in JSON/table mode, you can select Formatted to view this information easier.
  • SnapLogic Cloud Pattern Search and Preview

    • Introducing SnapLogic Cloud Pattern Catalog Search. You can now search the extensive set of Pattern Pipelines from SnapLogic and preview Pattern Pipelines that match your search criteria. You can either use a Pattern Pipeline to create a new Pipeline or copy its contents into an existing Pipeline.

    • Creating Branched Pipelines Using Pipeline Recommendations

      You can now create complex branched Pipelines using SnapLogic's Pipeline Recommendations feature. Just provide a start Snap, an end Snap, and an intermediary Snap and let Iris AI recommend Pipelines that connect all the three Snaps in a specified order.

Manager

  • Snaplex Notifications: Adding a Snaplex drop-down list for Notifications for ease of use. You can now set notifications for your Snaplex instances without having to look up the name in the Designer or Dashboard. When you configure a Snaplex notification, a drop-down list of Snaplex names appears.

Dashboard

  • Error Messages and Logs: Enhancing the troubleshooting experience in the SnapLogic Dashboard. Logging for JCC nodes is optimized so that duplicate or similar logs are filtered out, enabling you to find unique errors more quickly when you click View Details on the Snap Statistics tab in the Pipeline Executions Statistics popup.

Developer Portal

  • Logo and Banner Customization: Introducing the ability to customize your API Developer Portal. You can now add your own organizational logo and banner text to the Developer Portal from API Manager. Since the Developer Portal serves as the public catalog for your users to consume APIs, you can now customize the look to reflect your organization's branding.

Known Issues

General

  • Clicking the Execute button in the Try it section on the API tab of a Proxy might cause the Proxy window to abruptly close.

  • When configuring an account for a database Snap, the Search field is not enabled in the the drop-down list.

New UI Form

  • The Workday Reader Snap does not work with the New UI Form enabled because the accounts cannot be validated.
  • Leaving mandatory fields blank while configuring a Snap or its account, and then clicking Save should display an error message but does not when the New UI Form enabled.

Previous Dot Releases in 4.19 - UI

The following 4.18 UI Dot Release updates are now a part of the 4.19 release:

Update Date

Build

Updates

N/A

  • Fixes an issue where Data Preview does not work in eXtreme Pipelines.

  • Fixes an issue where Snap Suggestions do not appear when you open a second tab or subsequently on the initial tab displaying the Snap Suggestions.

  • Fixes an issue where clicking a Project folder named Alerts misdirects you to the Alerts page.

  • Fixes usability issues with Pipeline Recommendations.

  • Reverts a fix where certain output data with JSON Parser Snap is inaccurate, fixing which results in a regression issue in Data Preview. 

  • Updates the UI content and buttons for Suggested Pipelines/Snaps panel in the Designer's canvas to improve usability. 

N/A

  • Fixes an issue where you can only view the preview data after Pipeline validation completes. 

  • Fixes an issue where editing Snap settings in the Pipeline Execute Snap results in the following error message:
 Type error: Cannot set property ‘dialed’ of undefined.

  • Fixes an issue where File Previewer does not refetch the full HTML report.

  • Enhances Pipeline Recommendations by enabling a wizard that allows users to populate the Pattern tab with recommended Pipelines from the Patterns Catalog.

  • Fixes an issue with Snap recommendations where adding a Snap in a replaced suggested Pipeline and saving it results in an error.

  • Fixes an issue where selecting a recommended Pipeline through Pipeline Synthesis results in the middle snaps of the recommended synthesis Pipeline not having any input or output views.

  • Fixes an error where adding a Snap on the canvas when the Suggested Pipeline panel is open results in an error.


Snap Enhancements

  • Pipelines that start before a Snap update continue to run with the older version of the Snap. All Pipelines executed after a Snap update run with the new Snaps.
  • For Ultra Pipelines, the currently running instances continue to run with the older Snap Packs. Editing and saving the task instance in Manager causes a rolling restart of the Ultra Pipeline instances, and the new Snap Packs get picked up.
  • Customers using SQL Server with Windows authentication and SAP need to restart their Groundplex and Cloudplex instances.
  • New Snap Packs appear in the SnapLogic Designer only after all the JCC nodes in an Org are upgraded to the latest version.

General

  • AutoLink (formerly, SmartLink): Enhances the AutoLink feature to simplify the mapping of data by suggesting Input Schema mapping to the Target Schema in the Mapper Snap. The SnapLogic platform uses a combination of algorithms to derive mapping suggestions. AutoLink feature enables you to:
    • Filter mapping suggestions based on a score threshold.
    • Get the best mapping recommendations.
    • Map nested schemas easily as the machine learning model has higher flexibility for mapping nested schemas.
    • Preview and refine the matches.

  • SnapLogic B2B Integration: Leverages SnapLogic's capabilities to integrate the EDI gateway of 1 EDI Source with another EDI gateway or B2B solution. You can integrate with multiple applications supported by SnapLogic, such as NetSuite, SAP, and Oracle.

New Snap Pack

Updated Snap Packs

  • SOAP 
    • Introduces the Library API field to the SOAP Execute Snap to enable execution over HTTP. The supported libraries are Apache HttpComponents and Apache CXF, and both the libraries support the Message Transmission Optimization Mechanism (MTOM). 
    • Adds a new field, Allow duplicate headers, in the SOAP Execute Snap. Enabling this field allows duplicate headers value; if disabled, the last value of the duplicate header key is used.

  • Azure SQL: Enhances the error handling in PolyBase Bulk Load Snap when writing to a data warehouse. The Snap writes a new blob in the Azure container. This new blob highlights the first invalid row that caused the bulk load operation to fail.

  • Binary
    • The Key Passphrase field is now a mandatory field for the SSH Auth account. This update does not impact existing accounts and Pipelines. However, if you update existing SSH accounts or create a new account, then the passphrase is required. 
    • Raises the minimum buffer size in the S3 File Writer Snap to 6 MB.

  • SnapLogic Metadata: The /wiki/spaces/AP/pages/1438762 now features the Normalization checkbox, which, when selected, makes Pipeline comparisons easier.

  • ML Data Preparation: Introducing the Deduplicate Snap. Use this Snap to remove duplicate records from input documents. When you use multiple matching criteria to deduplicate your data, it is evaluated using each criterion separately, and then aggregated to give the final result.

  • Transform Snap Pack: The output of the AVG function in the Aggregate Snap now rounds up all numeric values that have more than 16 digits.

  • NetSuite: Supports NetSuite version 2019.1. While this does not impact any of your existing Pipelines, you can use the following WSDL configurations in your SnapLogic NetSuite accounts to benefit from this version's capabilities:
    • WSDL Year: 2019
    • WSDL Release: 1
    • WSDL Patch: 0

  • PostgreSQL: Adds new Snap, PostgreSQL Bulk Load, to support bulk load operations.

  • Salesforce: Introduces an account type Salesforce.com OAuth2 and the following Snaps that support the Bulk API v2.0:
  • Snowflake
    • Enhances the Snowflake SCD2 Snap to support auto-historization of column data by adding a new field-set, Auto Historization Query. You can now detect whether the incoming record is a historical event or a current event.
    • Raises the minimum buffer size in the Snowflake - Bulk Upsert and Snowflake - Bulk Load Snaps to 6 MB.

  • Workday: The Workday Write Snap now provides a Validate Only Load check box, which enables users to upload–and then manually validate–data before importing it into Workday.

  • ServiceNow: The Snap Pack supports the Madrid release of ServiceNow.

  • PostgreSQL Snap Pack: Added a new PostgreSQL Dynamic Account.

  • RabbitMQ Snap PackAdded the Auto delete check box, which enables you to indicate that the RabbitMQ autoDelete property associated with the existing queue is set to true.

  • Anaplan Snap PackRemoved the suggestion button from the Workspace and Model fields in the Snap Settings dialog. Hence, you need to enter the field values manually.  

Breaking Change: Fix to the Active Directory List Users Snap Might Fail Pipelines

We found an issue where the Active Directory List Users Snap inserts a space before every record of each field in the output. While we are fixing this issue in the 4.19 release, if you have Pipelines that have the Active Directory List Users Snap that assumes a space in the first character, then this fix might break your Pipelines. 

Known Issues

  • Generic JDBC - Execute Snap: If a SELECT query in the SQL statement field in the Snap Settings contains duplicate column names, then the query result displays the column name twice, with the latter mention prefixed with the table name. If the column name occurs more than twice, the second entry is still prefixed with the table name but it displays the value of the column mentioned last in the query. The example below illustrates this behavior. 

     Example: Incorrect results for SELECT queries with duplicate column names

    Example

    Consider the following query, where the column name "name" is repeated three times: 

    select id, name, city, location, id as name, city as name, location as name from address

    Expected output:

    The  Generic JDBC - Execute Snap's output should reflect the correct query result containing all the six fields, as shown in the image below:

    Actual output:

    The Snap's output displays the repeat occurrence of the column "name" only once, prefixed with the table name "address" as shown in the image below. Further, it holds the value of the table column "location", which was mentioned last in the SELECT query. 


    To avoid this issue, we recommend that you give unique column names in the query.

  • The ZipFile Write Snap with Use input view label enabled produces incorrect file names – different from the file names assigned by users.

  • The REST GET Snap Link HTTP response header maybe be malformed compared to other third-party applications like POSTMAN.

  • The File Delete Snap, when configured with a Google Service account, intermittently throws a NoClassDefFoundError: com/google/common/base/MoreObjects error. 

  • The following NetSuite Snaps currently do not support custom records: NetSuite Get, NetSuite Get List, NetSuite Async Get, and NetSuite Delete.

  • The Sandbox Account setting, available while creating a NetSuite account, does not work as expected. Do not select this check box while creating a sandbox NetSuite account.

  • The CSV Formatter Snap ignores escape characters when used along with any quote characters. When this happens, the resultant data cannot be parsed correctly using CSV Parser Snap which can cause an error. See Apache CSV Format issue for details.

Previous Dot Releases in 4.19 - Snaps

The following 4.18 Snap Dot Release updates are now a part of the 4.19 release:

Snap PackUpdate DateBuildUpdates
Confluent Kafka confluentkafka8111Fixes an issue with the Confluent Kafka Producer Snap wherein the Topic property doesn't evaluate expression against input documents.
Salesforce salesforce8066Fixes an issue with the Salesforce SOQL Snap wherein the Snap fails with NullPointerException.
Hadoop hadoop8033

Fixes an issue with the Parquet Writer Snap wherein the Snap throws an error when working with WASB protocol.

RabbitMQ rabbitmq8058Fixes an issue with RabbitMQ Snaps wherein the Snaps throw an error when the auto-delete setting is set to true.
Snowflake db/snowflake8044

Fixes an issue with the Snowflake - Select Snap wherein the Snap converts the Snowflake-provided timestamp value to the local timezone of the account.

MS Dynamics 365 for Sales dynamics365forsales7957
  • Fixes a NullPointerException issue with the Dynamics 365 for Sales Delete Snap wherein the Object ID is invalid.
  • Fixes a concurrency issue with multiple Dynamics 365 for Sales Snaps when running in parallel.
Binary binary8046

Enhances the Snap Pack to support AWS SDK 1.11.634 to fix the NullPointerException issue in the AWS SDK.

This issue occurs in AWS-related Snaps that have HTTP or HTTPS proxy configured without a username and/or password.

Snowflakedb/snowflake8044
Redshiftdb/redshift8043
Confluent Kafka confluentkafka8006

Fixes an exception that occurs when consuming log-compacted topics, in the Confluent Kafka Consumer Snap.

PostgreSQL postgres8021Fixes an issue with the PostgreSQL grammar to better handle the single quote characters.
Binary MULTIPLE7884Fixes an issue with the PostgreSQL grammar to better handle the single quote characters.
Snowflake<