November 2020, 4.23 Release Notes

In this article

Important

  • Per the SnapLogic Release Process, all remaining Snaplex instances across Orgs are auto-upgraded to the main-8600 - 4.23 GA (Recommend) version at 9 p.m. PT on December 19, 2020. Orgs migrated to any of the 4.23 GA versions prior to the auto-upgrade are not impacted. 
  • To use the new SnapLogic features and Snaps in the 4.23 release, ensure that your Snaplex nodes are upgraded to the recommended version (main-8600 - 4.23 GA).
  • This 4.23 release includes the patches deployed to SnapLogic after the 4.22 release, as listed in the 4.22 Dot Releases page. 


Groundplex Support for Java 11 and Sunsetting Java 8

  • Groundplex––Per the 4.22 release announcement, we are only supporting Java 11 and have ceased support for Java 8.

Key New Features

  • Extends the API Policy Manager by adding the API Developer Portal and API management capabilities.
  • Find and reuse your existing Snaps for designing new Pipelines via the Configured Search tab of the Universal Search functionality.
  • Customize your SnapLogic dashboards using the widget toggle feature.
  • Revamps the API dashboard to improve reporting and usability.
  • Adds new Snaps to integrate HubSpot, Microsoft Exchange, Microsoft OneDrive, and Slack applications.
  • Adds HTTP Router Snap in the Flow Snap Pack
  • Adds List Read Items Snap to SharePoint Online Snap Pack
  • Adds ELT Snaps related to load, sample, pivot, unpivot, and SQL Window Functions
  • Extends ELT Snap Pack to support Amazon Redshift database.


4.23 UAT Delta

This section tracks the changes made during the iterative pushes to the UAT server and the GA release. The following is the release schedule:

  • UAT 1: Friday, October 30, 2020 (Release features are published below)

  • UAT 2: Friday, November 06, 2020

  • GA: Saturday, November 14, 2020 (9 p.m. PT)

The SnapLogic GA build on the production server is also deployed on the UAT server.

UAT 2 Fix

Platform

  • Fixes an issue with the Universal Search when using the Configured Snap tab that fails with a script error when searching with the find word.

4.23 Dot Releases

Platform

Date of UpdateSnaplex BuildUpdates
 
N/AControl Plane patch for performance optimization of the SnapLogic Platform.
 
main-8777 - 4.23 Patch 1 (Recommended)Planned enhancements to align the SnapLogic Platform with the latest security recommendations.

UI

Date of UpdateUpdates
 
  • Fixes an issue in the Excel Multi Sheet Formatter Snap wherein the values in the Input view name column are deleted after saving the Snap Settings
  • Fixes an issue in Snaps that use a custom XML wherein an additional new line (CR LF) might get added to some XML elements when the editor is opened using the Customize Envelope button in the Snap Settings dialog.

Standard-mode Snaps

Snap PackDate of UpdateSnap Pack Build NameUpdates
Transform  423patches7958

Fixes an issue in the JSON Splitter Snap by not logging a NumberFormatException error, that is, an error which is logged while converting a string into a numeric value.

Binary 423patches8453Fixes an issue in the File Writer Snap with the ADL protocol, to perform the correct action when OVERWRITE is selected from the File Action drop-down field.
 423patches8397Fixes an authorization issue in the Snap Pack by migrating to a verified Google OAuth application.
Binary 423patches8368Fixes an encryption issue with the File Operation Snap by implementing both SSE-KMS and SSE-S3 supports to the Snap.
JDBC 423patches8027Fixes a multiple connection issue in the JDBC Snap Pack that occurs when the Auto Detect field is enabled for each execution of the Snap by storing a copy of the database name.
Binary 423patches8368

Fixes an issue in the Binary Snap Pack by removing the plaintext credentials in the file URL from the JCC log messages.

Active Directory

LDAP

 423patches7454

Adds the Pass through check box in all the Snaps to include pass-through functionality. Select this check box to embed the upstream input documents under the original field of the output document along with other records.

Active Directory  423patches8210

Fixes an issue of fetching search records in the Active Directory Search Snap by adding a new field, Limit, to specify the number of search records to fetch from the Active Directory.

Your existing Pipelines that use Page Size for limiting records may fail to execute. Hence, modify your Pipelines using the Limit field.

SQL Server  423patches8190Fixes an issue with SQL Server - Execute to handle SQL statements that begin with special characters.
Binary 423patches8099Enhances the Snap Pack by upgrading the SMB client library.
Google Directory  423patches7817Fixes the authorization issue in the Snap Pack by migrating to a verified Google OAuth application.
Binary 

 

423patches7958Fixes an issue with the File Writer Snap by avoiding overwriting of documents when appending the data to a CSV file in SFTP.
Confluent Kafka 423patches7900
  • Removes the Confluent prefix from the Snaps and accounts in the Snap Pack. However, the Snap Pack name continues to be Confluent Kafka Snap Pack.

  • Adds Wait For Full Count check box to the Kafka Consumer Snap to determine how a positive value for the Message Count field must be interpreted.

    • Enabled (by default): The Snap continues polling for messages until the specified count is reached.

    • Disabled: If there are fewer messages currently available than the specified count, then the Snap consumes the available messages and terminates.

      Known Issue

      The Wait For Full Count check box activates only when you provide a positive integer value in the Message Count field. However, it does not activate when you use an expression for Message Count even if the value evaluates to a positive number.

      Workaround: To activate this check box, temporarily replace the Message Count expression () with a positive integer, select the desired state for Wait For Full Count, and then restore the original value in the Message Count field.


  • Adds support for writing and reading record headers.

    • The Kafka Producer Snap has a new Headers table to configure the Key, Value, and Serializer for each header to be written.

    • The Kafka Consumer Snap reads any headers present on the records it consumes. It provides two new fields to configure how the header values should be deserialized – Default Header Deserializer and Header Deserializers, for any headers that require a deserializer other than the default.

  • Adds support for writing and reading each record’s timestamp.

    • The Kafka Producer Snap has a new Timestamp field that can be configured to set each record’s timestamp, which is the number of milliseconds since the epoch (00:00:00 UTC on January 1, 1970). This can be set to an expression that evaluates to a long integer, or a string that can be parsed as a long integer, or a date. If you specify no expression, or the value is empty, then the timestamp is set to the current time.

      The Timestamp field is only relevant if the Kafka topic is configured with message.timestamp.type = CreateTime (which is the default). For more information, see the official Kafka documentation.

    • The Kafka Consumer Snap has a new check box, Include Timestamp, which by default is disabled for backward compatibility. If enabled, the output for each record includes its timestamp in the metadata.

  • The Kafka Producer Snap has a new check box, Output Records, to determine the format of each output document when configured with an output view.

    • Disabled (by default): The Snap’s output includes only the basic metadata (topic, partition, offset) for each record, along with the original input document.

    • Enabled: Each output document contains a more complete representation of the record produced, including its key, value, headers, and timestamp.

  • The Kafka Consumer Snap has a new field, Output Mode, with two options:

    • One output document per record (the default): Every record received from Kafka has a corresponding output document.

    • One output document per batch: Preserves the batching of records as received from Kafka. Every poll that returns a non-empty set of records results in a single output document containing the list of records as batchbatch_size and batch_index. This mode is especially useful when Auto Commit is disabled and Acknowledge Mode is Wait after each batch of records, depending on the nature of the processing between the Kafka Consumer and the Kafka Acknowledge Snaps.

  • Removes the Add 1 to Offsets check box from the Kafka Consumer Snap.

  • Removes the Account tab from the Kafka Acknowledge Snap, as it no longer needs an account.

The Confluent Kafka Snap Pack documentation will be updated along with 4.24 GA, scheduled for .  

Transform  423patches7898
  • Fixes an issue in the In-Memory Lookup Snap to correctly handle the Join path in the format like $['join path'].

  • Fixes an issue in the XSLT Snap, wherein null binary header values are now converted to blank strings when injecting them as parameters in the stylesheet.
Transform  423patches7792

Fixes an issue in the XML Formatter Snap when it fails to convert input JSON data, with the JSON property having a special character as its prefix, to the XML format by sorting the elements.

Binary  423patches7958

Rolls back the recent patch to Binary Snap Pack (File Writer Snap - 423patches7923) that might induce SSL handshake failures/terminations in existing Pipelines. 

Salesforce  423patches7888
Fixes the the following Snaps to ensure that they maintain lineage when using in Ultra Pipelines. 
This fix does not affect the bulk action Snaps in this Snap Pack that produce more than one output document for each input document.
Binary 

 

423patches7923
Fixes the SFTP connection failure issue in the File Writer Snap by:
  • Ensuring that the BouncyCastleProvider is the first in the list of providers in the Security object.
  • Upgrading the BouncyCastle version to 1.67.

As of April 20, 2021, we recommend that you not use the 423patches7923 build for the File Writer Snap, because it causes connectivity issues with the Snaplex nodes.

Snowflake 423patches7905Fixes the performance issue in the Snowflake - Bulk Load Snap while using External Staging on Amazon S3.
Binary  423patches7795

Fixes an issue with File Writer Snap by skipping the validation of the SAS URI having write permission, if the SAS URI uses an access policy.

JDBC 

 423patches7800

Fixes an issue with JDBC account through a Test Query option to establish a database connection upon using Auto detect option for the Database name.

Google Spreadsheet  423patches7848Enhances the Google Spreadsheet Snap Pack by migrating from v3 to v4 API as Google announces sunsetting the v3 API on June 8, 2021. For more information, see Impact on Migrating Google Spreadsheet Pipelines from v3 to v4.
Marketo 423patches7812

Introduces the Marketo Snap Pack to enable you to automating the process of performing operations to the Asset database and Lead database that manage the potential data for an organization in the marketing industry.

  • Asset Read: Queries the Asset database to retrieve assets using commands.
  • Asset WriteInteracts with the assets using commands and make modifications to the Asset database.
  • Lead Read: Queries the Lead database to retrieve leads using commands.
  • Lead WriteInteracts with the leads using commands and make modifications to the Lead database.
  • Bulk Lead ExtractRetrieves leads in bulk from the Lead database.
  • Bulk Lead UpsertInserts/Updates large number of leads in the Lead database.
OpenAPI 423patches7812Introduces the OpenAPI Snap Pack to enable you to connect to your OpenAPI endpoints. This Snap Pack supports OpenAPI Specification versions 2.0 and 3.0.
SOAP 423patches7441

Enhances the SOAP Execute Snap by including an additional output view. When named debug (all lower-case), the Snap outputs the SOAP request headers, envelope, and the output document that is written to the default output view. 

Script 423patches7671

Fixes an issue with the PySpark Snap by removing the dependency on the json-path library, thus avoiding a conflict between the external library version and the SnapLogic json-path.jar.

MySQL  423patches7732

Fixes an issue in the MySQL - Bulk Load Snap to support the following versions:

  • MySQL 8.0.17 
  • MySQL 5.6.34
Microsoft Power BI  main76Updates the dependencies and documentation links for all the Microsoft Power BI Snaps.
Transform 423patches7753Fixes an issue with the JSON Splitter Snap's behavior in Ultra Pipelines that prevents processed requests to be acknowledged and removed from the FeedMaster queue, resulting in retries of requests that are already processed successfully.
Binary 423patches7660Enhances the File Poller Snap by adding a field, Exit on first matches, which when set to true stops the Snap from executing after the first file paths matching the filter are written to the output view. If the field is not configured or is set to false (default value), then the Snap continues to poll the directory until the Polling timeout is reached.
SharePoint Online main75

Fixes the error view issue in SharePoint Online - Upload File Snap by dragging a new instance of SharePoint Online - Upload File Snap to the canvas, since the existing Snap that is used with a version that contains the bug continues to fail.

Hadoop 423patches7440Fixes the issue in HDFS Reader Snap by supporting to read and write files larger than 2GB using the ABFS(S) protocol.
SAP HANA 
 
423patches7548Fixes the batch size issue in SAP HANA - Upsert Snap by using a prepare statement when sending the batch request.
Box
 
423patches7526Fixes the intermittent failure in access token refresh for the Box OAuth2 account by adopting the refreshAccessTokenIfExpired() method that checks and refreshes the access token within the last minute of its expiry.
SharePoint Online 
 
main74

Fixes the socket timeout issue in the Snap Pack by making the following changes:

  • Modifies the code to return the ProxyHttpClient instead of the basic HTTP client and handle the custom siteName.
  • Fixes the broken JUnit and code for pagination in the SharePoint Online - List Read Items Snap.
Adobe Experience Platform (Deprecated in 4.24 GA)
 
423patches7447Fixes the Adobe Experience Platform Execute Snap issue of not passing data correctly to the downstream Snap by creating Map obj = new LinkedHashMap(); inside loop. LinkedHashMap is a hash table and linked list implementation of the Map interface, with a predictable iteration order. 
Splunk 
 
423patches7504Enhances the Splunk Search Snap by adding a new field, Response Mode, which allows receiving either JSON or XML response from the Splunk server. The default mode is XML, to enable backward compatibility.
SAP
 
422patches7378Enhances the SAP Execute Snap to process the structure that contains nested Table Type fields in the output document by recursively parsing them into a Map or a List set.


Platform 

Snaplex-Level Scheduling Available for Scheduled Tasks

We encourage you to switch your scheduling of Tasks to Snaplex-level Scheduling. Introduced in the 4.22 SnapLogic Release (August 2020) as an opt-in feature, Snaplex-level Scheduling improves accuracy with the execution of Scheduled Tasks. In the 4.24 Release (February 2021), Snaplex-level Scheduling will be the default mechanism for scheduling Tasks that run 5 minutes or less.

Contact your CSM (Customer Success Manager) to enable Snaplex-level Scheduling now for your Tasks.

New Features

  • Search for configured Snaps to reuse in your Pipelines: Adds Configured Snap Search capabilities to the Universal Search in SnapLogic. In addition to SnapLogic Documentation and Community sources, you can now search for existing Snap Configurations in your Projects. When you find a Snap Configuration that suits your use case, you can clickto copy the Snap, then right-click and select Paste to add it to the Canvas for ease of use. This tool enables you to reference existing configured Snap field settings while you build Pipelines.


  • Launching the API Developer Portal: The new APIM Developer Portal is a space where you can publish target Triggered and Ultra Task APIs from your Org. 
    • The Developer Portal is accessible to non-SnapLogic users as well, providing them an external space to explore and download APIs created from your SnapLogic Pipelines.
    • Use the Native API Manager to publish, unpublish, and republish your APIs. You can customize your Developer Portal.
    • As an Org admin, you can manage the access to API endpoints created from Pipelines with the API Policy Manager, as well as apply traffic shaping policies (such as rate limiting) at the Project level. 



Previous API Management Solution to be Deprecated in 4.24

The previous API Management solution that bundled Triggered and Ultra Tasks into proxies will be deprecated in the February 2021, 4.24 release.

  • Revamping the API Dashboard: Introduces the improved API Dashboard that works in conjunction with the API Manager and Developer Portal. You can now monitor the number of errors, understand their source (server or client), track the top APIs by requests, and view execution statistics of the underlying Pipeline. The All API Details report allows you to view each API, sortable by metric or API name as well as being searchable in the report. Clicking a target Task API in the Details report displays all the requests for that Task API. You can then launch Manager > Task Details for the target Task API in a separate browser tab.


Enhancements 

  • Usability Improvements for the Asset Palette in Designer: Enhances the Asset Palette, which offers more space on the Designer Canvas and improves the user experience with a Catalog of Snaps, Pipelines, and Pattern Pipelines. To facilitate working on multiple Pipelines, the following menu settings in the Asset Palette now persist when you switch between Pipelines and Pipeline Patterns, even if you launch a new tab or hide the menu from view:
    • Scroll bar position 
    • Search filter
    • Expand/collapse actions

  • Customize your SnapLogic Dashboards: Adds the show/hide toggle () on the area charts for the Snaplex, Insights, and API tabs in your Dashboard, enabling you to focus/expand on specific widgets that have the required data. The new widget menu allows you to choose which area charts to display on the dashboard.

  • Sort through search results in the Cloud Pattern Catalog: Enhances the usability of the Pipeline Pattern Catalog in the new Asset Palette, you can now browse more easily through a long list of search results for Pipeline Patterns using the Show All and Show Only Matches options. Clicking Show All displays all Pipeline Patterns in that Project related to the search term, whereas clicking Show Only Matches displays those results that match the search term exactly. 

  • Create a child Pipeline with a drag and drop action from the Pipeline Catalog: Adds the ability to create a child Pipeline with greater ease. You can now browse the Pipeline Catalog for the target child Pipeline, and then select, drag and drop it in the Canvas. The SnapLogic Designer automatically adds the child Pipeline using a Pipeline Execute Snap.


  • See a Pipeline Preview: Adds the ability to preview a child Pipeline by hovering over a Pipeline Execute Snap while the parent Pipeline is open on the Designer Canvas.
  • Scroll through your Input Schemas with the Mapper Snap in the New UI: Updates the way in which Mapper Snap displays schema fields in the new UI to act similarly to the Mapper Snap in the old UI display, providing continuity in user experience with database mapping in this popular Snap. To receive all the benefits of the new UI display, select New Form UI in the Designer > User Settings.

  • Use One Identity Provider across Multiple Orgs with the Updated SSO Login: Enhances the SSO functionality in SnapLogic Manager to support using one Identity Provider (IdP) metadata file across multiple Orgs. Users who belong only to one Org (and not multiple Orgs) can now log into SnapLogic regardless of which Org the IdP metadata references. For example, previously, if you belonged to OrgB, but the IdP used OrgA's metadata, then your login to OrgB would fail with the following error message:


    Starting with the 4.23 Release (November, 2020), we now allow users to access only their Orgs in this implementation of SSO.

Known Issue

  • GitHub Integration: In the SnapLogic 4.23 Release (November 2020), checking out an empty repository may result in an error during a commit because of an API upgrade in the Platform. As a work-around, make sure to add README.md file when you create a new repository in Github.

Behavior Change

Simplifying Snaplex status: Starting with the SnapLogic 4.23 Release (November, 2020), Snaplex instances have only two states: Running and Down. Previously, running the Snaplex Public API would return a response with the Stopped state. Now, when you run the Snaplex Public API, any node that is not in a Running state displays a Down status.


Standard-mode Snaps

New Snaps

  • Active Directory Authenticate Users Snap: A new Snap in the Active Directory Snap Pack that enables you to use SnapLogic Platform to authenticate Active Directory (AD) users against the configured AD server.

  • HTTP Router Snap: A new Snap in the Flow Snap Pack that enables API developers to route multiple HTTP requests appropriately based on the request method (GET, PUT, PATCH, etc.) when executing Pipelines as Triggered Tasks.

  • HubSpot Snap Pack: Enables you to integrate with your HubSpot instance. This Snap Pack includes the following Snaps:
  • Marketo Snap Pack: Enables you to automate the process of performing operations to the Asset database and Lead database, these database manages the potential data for an organization in the marketing industry.
    • Asset Read: Queries Asset database to retrieve assets using commands.
    • Asset WriteInteracts with the assets using commands and make modifications to the Asset database.
    • Lead Read: Queries Lead database to retrieve leads using commands.
    • Lead WriteInteracts with the leads using commands and make modifications to the Lead database.
    • Bulk Lead ExtractRetrieves leads in bulk from the Lead database.
    • Bulk Lead UpsertInserts/Updates large number of leads in the Lead database.
  • Microsoft Exchange Online Snap Pack: Enables you to automate and efficiently manage Microsoft Exchange Online Emails, Events, and Contacts. This Snap Pack includes the following Snaps:
  • Microsoft OneDrive Snap Pack: Enables you to automate and efficiently manage time-intensive workflows and data flows among Microsoft OneDrive users and administrators. This Snap Pack includes the following Snaps:
    • Check In File: Commits/saves changes to a checked-out file and to open it for other collaborators to modify the file.

    • Check Out File: Locks a file on your name as you start editing the file. Other users cannot edit this file until you check-in the file to its location or cancel the Check Out operation. 

    • Copy Item: Makes copies of the files and/or folders from a given location to another location across drives.

    • Create Folder: Creates a new directory within your Drive location.

    • Delete Item: Deletes a file/folder/Drive Item from its location within your Drive.

    • Delete Share Permissions: Removes/revokes any permissions assigned to one or more users on the various assets within a OneDrive location.

    • Download File: Saves a local copy of the file existing in a OneDrive location.

    • Get Children: Retrieves the directory structure of the contents inside a folder within Drive.

    • Get Drive: Retrieves the details of the Drive that you can access.

    • Get Drive Item: Retrieves the details of the Drive Item that you can access.

    • Get Share Permissions: Retrieves the existing set of permissions on a given Drive Item (folder or file).

    • Move Item: Moves Drive Items (files/folders) from a source location to another destination within the Drive.

    • Search: Locates the content/pages matching search keywords and usernames.

    • Share Item: Provides access or invite other users who do not have access to an item within the Drive.

    • Get Shared Items: Displays the list of shared items that were recently opened.

    • Update Share Permissions: Modifies the existing permissions for a Drive Item.

    • Upload File: Saves a copy of an existing file to a location within your Drive.

  • Microsoft Power BI Snap PackIntroduces the Microsoft Power BI Snap Pack that enables you to access and control entities such as datasets, reports, gateways, and dashboards in the workspace. The Microsoft Power BI Snap Pack contains the following Snaps:
  • SharePoint Online - List Read Items Snap: A new Snap that enables you to read, sort, and filter list items from your SharePoint Online libraries/collections.

  • Slack Snap Pack: Integrate and automate your Slack environments to improve collaboration across your teams, thus improving productivityThis Snap Pack includes the following Snaps:
    • Channel OperationsPerforms operations in your Workspace such as create a Channel, invite users, list members, and archive/unarchive channels.
    • Delete File: Deletes files that a user/bot has uploaded/shared in a Channel, Private group, or Direct message.

    • Delete Message: Deletes the messages that a user/bot has uploaded/shared in a Channel, Private group, or Direct message.

    • Search: Searches for messages and files using either keywords, sender/recipient, as well as date/duration when they were sent.

    • Send Message: Provides complete messaging capabilities that a Slack desktop installation offers—such as formatting messages, special characters, emojis, code snippets, and hyperlinks.

    • Update Message: Allows editing messages that a user/bot has sent, in case they need updates.

    • Upload File: Uploads/shares files as part of conversations in a Channel, Private group, or Direct message.

    • User Operations: Performs user operations such as retrieving user information, as well as adding and removing users from your Workspace. Requires an Enterprise Grid installation of Slack to perform some of these operations.

    • Workspace Operations: Performs operations such as retrieving Workspace details, creating a new Workspace, retrieving the list of Workspaces, users, or Channels, and deleting Channels. Requires an Enterprise Grid installation of Slack to perform some of these operations.

Updated Snap Packs 

  • Active Directory Snap Pack: Enhances the Active Directory Search Snap by adding a new field, Group resultsto group the output result in a single array.

  • Adobe Experience Platform Snap Pack: 
    • Replaces the Adobe Cloud Platform Snap Pack.
    • Introduces the Adobe Experience Platform Read Snap that enables executing SQL queries in the Adobe Experience Platform.
    • Updates the Adobe Experience Platform JWT Account to enable you to create accounts in a Sandbox location during the development phase.
    • Enhances the Adobe Experience Platform Read Snap by adding fields, Batch IDsStart date, and End Date to allow filtering batches by ID, start date, and end date with millisecond precision.

  • Azure SQL Snap Pack: Enhances the Azure SQL - Bulk Extract Snap by adding a new check box Enable UTF-8 encoding to support UTF-8 encoded characters. Selected by default, this check box allows the Snap to update the BCP command to read the special characters.

  • Binary Snap Pack: Enhances the ZipFile Write Snap to provide the ability to change the default content-type (application/octet-stream) for any file that is stored into the Azure Blob Storage (WASB: or WASBS: file protocol). Hence, the files that the ZipFile Write Snap writes into the Blob Storage can be saved with content-type as application/zip or any other type instead of application/octet-stream always.

    Behavioral Change

    You can now prevent the Snap from writing files always to Azure Blob Storage (WASB: or WASBS: file protocol) with the application/octet-stream content-type. To do so, configure a binary header property in an upstream Snap, such as JSON Formatter or Mapper, to match the file's content – application/zipapplication/java-archive and so on; and pass it as the $content-type (case-sensitive) for the file.

    Binary header property in upstream Snap

  • Kafka Snap PackFixes an intermittent issue of Confluent Kafka Consumer Snap stopping when Message Count is 0 while the records are available. The Snap will now stop only if a poll returns no records twice in a row, and has partitions assigned before and after each poll.

  • Flow Snap PackFixed the Head Snap issue by closing the output view after writing the last output document so that downstream snaps can complete, even while the Head Snap continues to consume any available input.

  • Google BigQuery Snap Pack
  • JDBC Snap Pack:
    • Fixes an issue with the JDBC account that displays a connection is closed error when connecting with the SQL server.

    • Fixes an issue with the JDBC Snaps that fail while displaying the javax.management.MalformedObjectNameException: Invalid character '=' in value part of property error repeatedly when there is “=“ or ”:” in the JDBC URL connection.

  • Redshift Snap Pack: Fixes an issue with the Redshift Bulk Load Snap that fails while displaying a Failed to commit transaction error.

  • REST Snap Pack: Improves the handling of expired access tokens in REST Snaps that use OAuth2 accounts (REST OAuth2 Account and REST OAuth2 SSL Account). The Snaps can refresh expired access tokens on-demand, through a request to the platform. The Snap reloads the account with the updated/fresh access token before attempting the next retry.

  • SAP S/4HANA Snap Pack: Enhances the Snap Pack to handle batch and custom query operations:
    • Introduces the SAP S/4HANA Batch Read Snap that enables retrieving batches of records from an SAP S/4HANA On-Premise instance.
    • Introduces the SAP S/4HANA Batch Write Snap that enables writing batches of records to an SAP S/4HANA On-Premise instance.
    • Introduces the SAP S/4HANA Read Custom Query Snap that enables retrieving multiple records from an SAP S/4HANA On-Premise instance, based on custom queries.
    • Introduces the SAP S/4HANA SSL Auth Account type to enable SSL-based authentication on an SAP S/4HANA On-Premise instance.
    • Adds the Count field to the SAP S/4HANA Read Snap to allow returning the total number of records retrieved.

  • Snowflake Snap Pack
  • SQL Server Snap Pack: Enhances the accounts in this Snap Pack to allow Windows-based (Active Directory) authentication and user impersonation for SQL Server user accounts.

  • Teradata Snap Pack: Updates the version of Teradata Tools and Utilities base for this Snap Pack to TTU 16.20.25.00 Linux - Base instead of TeradataToolsAndUtilitiesBase__Linux_i386-x8664.15.10.06.00.tar.gz.  

  • Transform Snap Pack: Enhances the JSON Formatter Snap to render groups output from upstream (Group by) Snaps with one document per group and a new line per group element. You can now select the Format each document and JSON lines check boxes simultaneously.

Deprecated Snaps

  • Google DFA Snap Pack: Starting from 4.23 GA, we are retiring the Google DFA Snap Pack from the Snaps Catalog.

  • Oracle E-Business Suite (EBS) Snap Pack: Starting from 4.23 GA, this Snap Pack is deprecated. Contact support@snaplogic.com, if your existing Pipelines have Snaps from the Oracle EBS Snap Pack.

Known Issues

  • Google Analytics AccountsIn the 4.23 release, we have migrated to a new Google OAuth application that the Google Analytics Snap Pack uses when authorizing and authenticating users. The new OAuth application is verified by Google and should not result in warnings any longer for new user authorizations. Although existing accounts should work without modification, we recommend you to either create new Google Analytics Snap Accounts or manually re-authorize existing accounts by clicking the Authorize button to migrate to the new verified client.

  • NetSuite and Salesforce Accounts: When configuring new accounts, the account validation fails if the account settings are not saved (if you click Validate before clicking Apply). This issue is persisting since 4.22 GA, but does not affect the execution of existing Pipelines. A workaround is to first click Apply (thus saving the account settings) and then clicking Validate, which successfully validates the account, assuming the account configuration is correct.  

  • Microsoft OneDrive Snap Pack
    • Snaps in this Snap Pack have a built-in retry mechanism for failing connections and requests; but, a high volume of requests from a client might reach the throttling threshold. In such scenarios, the Microsoft Graph limits further requests from that client for a period of time and returns an HTTP status code 429 (Too many requests), thereby causing the requests to fail. Hence, we recommend that you keep a check on the number of requests emanating from your client instance.
    • The Copy Item Snap copies the item to the root folder when you provide invalid Target Relative Path/ID (without root:/). However, the Snap works as expected (throws an exception) when you provide an invalid Target Relative Path/ID that begins with root:/. We recommend that you ensure that the Target Relative Path/ID always resolves to a valid folder.

  • CSV Formatter Snap: This Snap prepares the column header for the output view (and hence the CSV file) using the keys defined in the first record. This may result in ignoring any additional key passed in the subsequent records. We recommend that you pass the values for a comprehensive set of all keys used in the input view for the first record.


Prior 4.22 Snap Dot Releases are Merged into 4.23 GA 

 Click here to expand...

Snap PackDate of Update Snap Pack Build Name Updates
Snowflake 422patches7246Fixes an issue with the Snowflake Snaps that fail while displaying the same error message, javax.management.MalformedObjectNameException: Invalid character '=' in value part of property, repeatedly when there is “=“ or ”:” in the Snowflake URL connection.
JDBC 422patches7246Fixes an issue with the JDBC Snaps that fail while displaying the same error message, javax.management.MalformedObjectNameException: Invalid character '=' in value part of property, repeatedly when there is “=“ or ”:” in the JDBC URL connection.
Anaplan  422patches7392

Fixes the Snap Pack error handling issue by reverting the getChunk method, that returns a variant that contains all or a part of the contents of a large text or binary data Field object, of 1.4.4.2 jar version to 1.4.4.1 jar version and upgraded the jar version to 1.4.4.3.

Splunk  422patches7312Enhances the Splunk Search Snap by adding a new field, Response Mode, which allows receiving either JSON or XML response from the Splunk server. The default mode is XML, to enable backward compatibility.
SAP  422patches7378

Enhances the SAP Execute Snap to process the structure that contains nested Table Type fields in the output document by recursively parsing them into a Map or a List set.

Anaplan  422patches6561
  • Fixes the Anaplan Snaps by displaying the same value for both Task ID and Task Name, by following the Anaplan client SDK.
  • Enhances the Anaplan Snaps by allowing you to provide interchangeable inputs for the following fields: 
    • Workspace ID and Workspace Name
    • Model ID and Model Name

Introduces a suggestible option that enables you to select the Workspace Name and Model Name.

SharePoint Online main39

Fixes the Snap document link for SharePoint Online - List Read Items.

REST 422patches7103

Enhances the Snap Pack by separating the retry logic for OAuth account from that of the REST Snap.

This enhancement improves SnapLogic’s OAuth account refresh process around multiple, concurrent token refresh requests. Thus increasing the number of retries to acquire a valid access token, independent of the retries a user can configure in the REST Snap.

So, if a REST Snap encounters a 401/403 error, the Snap checks with the SnapLogic Platform if a newer version of the account exists and, if yes, reloads the updated account information and retries the request. Else, the REST Snap can ask the platform to acquire a new refresh token immediately and retry the request. If the token endpoint is not reachable, then the Snap retries with its existing account.

In case of any other error, the Snap simply uses the user-configured retry policy. 

Snowflake 422patches6849

Enhances the Snowflake Snaps by adding a new field, Manage Queued Queries, to decide whether the Snap can continue or cancel the execution of the queued Snowflake Execute SQL queries. The field is introduced in the following Snaps:

Behavioral Change

Enhances Snowflake Snaps by enabling the Session Management of the Snowflake Queries to be able to track and cancel. Hence, both Queued and Running status queries will be cancelled when user selects ‘Cancel Queued Queries when the Pipeline stops or fails option. 

 

Box  422patches6992Fixes the Box Write Snap by allowing the Snap to retry only when the given input is at least '1' in the Number of retries field. This fix removes the Enable Staging field.
JMS  422patches6992

Fixes the JMS Snap Pack by replacing JMS class loader for Oracle AQ (Advance Queuing).

Binary  422patches6947

Fixes the hanging threads issue in the SMB accounts.

SAP S/4HANA  422patches6973

Enhances the SAP S/4HANA Snap Pack with the following additions:

SAP HANA  422patches6940

Fixes the stored procedure name conflict issue in the SAP HANA - Stored Procedure Snap, when the stored procedure exists in multiple schemas, by parsing each procedure name.

PostgreSQL  422patches6879

Fixes the PostgreSQL - Bulk Load Snap by preventing it from adding extra double quotes when loading values from input documents.

Binary  422patches6950

Enhances the S3 Dynamic Account by allowing to use the Security token field in Directory Browser, File Operation, File Poller, Multi File Reader, and File Delete Snaps.

SOAP 422patches6770Enhances the SOAP Execute Snap by adding the WSSE header to support SOAP WSSE Account with the Apache HttpComponents library.
JDBC 422patches6772Fixes the Generic JDBC - Execute Snap by implementing the JDBC Auto detect feature to use the correct database name.
 422patches6796Fixes the JCO_ERROR_REQUEST_CANCELLED (connection is closed) error in the SAP Execute Snap that occurs even when the session is active after 10 minutes.
Azure SQL 422patches6751Enhances the Azure SQL - Bulk Extract Snap by adding a new check box Enable UTF-8 encoding to support UTF-8 encoded characters. Selected by default, this check box allows the Snap to update the BCP command to read these special characters.
 422patches6781

Fixes the Google Analytics Snap Pack by authorizing the Google OAuth2 account.

SQL Server  422patches6728

Enhances the SQL Server Snap Pack to allow Windows (Active Directory) based authentication and user impersonation for SQL Server user accounts.

Email  422patches6730

Fixes the connectivity issue in the Email Sender Snap by making it compatible with TLS version 1.2.

SAP  4.22patches6601Enhances the SAP Execute and SAP IDoc Write Snaps by introducing the following fields:
  • Reload Function Metadata: To get latest schema.
  • Reload Metadata and Validate: Allows clearing the JCo Metadata cache on the Snaplex node before each validation.
SOAP 422patches6656

Fixes the SOAP Execute Snap failure due to different character-sets used in the HTTP request data.

SharePoint Online 422patches6694
  • Fixes the List Read Snap NPE(null pointer exception) failure, when the List Name field is empty.
  • Fixes the Search Items Snap issue by providing the same result set when more than one document is passed.
SAP  422patches6597

Enhances the SAP Execute Snap by introducing the following two fields:

  • Commit Timeout (sec): Creates a session to call BAPI and commit.
  • Session ID: Identifies specific sessions for all the Snaps that are in a stateful call sequence.
Binary 422patches6629

Fixes the ZipFile Write Snap error by allowing the number of retries to be set greater than 0.

Flow

 

422patches6648

Enhances the Data Validator Snap by making the Constraint value field as optional under the Constraints.

MySQL 422patches6629Fixes the MySQL - Select Snap by acknowledging the lineage information of the original document in an empty output view when Pass Through is enabled. 
Transform
 
422patches6505Fixes the XML Generator Snap issue reflecting empty tags and extra space by removing the extra space in the XML output.
Transform 422patches6395Fixes the JSON Splitter Snap data corruption issue by copying the data in JSON Splitter Snap before sending it to other downstream Snaps.
Binary
 
422patches6542Fixes the SMB hanging threads by upgrading SMB client library.
Active Directory
 
422patches6531Enhances the Active Directory Create Entry and Active Directory Update Entry Snaps by adding Attribute Value Delimiter field to separate multiple values entered in the Attribute value field.


Data Automation

SnapLogic's data automation solution speeds up the identification and integration of new data sources or the migration of data from legacy systems. The solution can automatically detect duplicate, erroneous, or missing data, or identify structures and formats that do not match the data model. Data automation can accelerate the loading and transformation of your data into the data warehouse, speeding up the data-to-decisions process.

ELT: New Feature

  • Adds support for Amazon Redshift database. You can now use the ELT Snap Pack to transform tables in the Redshift as well as Snowflake databases.

Updated Snap Pack

  • ELT Snap Pack: Introduces the following Snaps:
    • ELT Load: Loads data from AWS S3 buckets and Azure clusters into the Snowflake and Redshift tables.
    • ELT Sample: Generates a data subset from the source table. 
    • ELT Pivot: Converts row data into column data.
    • ELT Unpivot: Converts column data into row data.
    • ELT Window Functions: Provides support for SQL Window Functions in ELT Pipelines.

  • Configuring ELT Database Accounts: Enhances the ELT Database Account to support the Redshift database.

  • ELT Aggregate: Enhances the Snap to support Redshift's aggregate functions. This enhancement also makes account configuration mandatory when using this Snap.

  • ELT Insert Select: Adds a new field set, Insert Expression, to the Snap. This field set allows you to configure the values of the columns in the target table during the insert operation. 

eXtreme (Big Data): New Features and Enhancements

  • AWS Launch Stack: Adds Amazon's launch stack support for configuring your AWS-based eXtremeplex instances.

  • eXtreme AWS IAM Role Account: Enhances the account type to support using Organization ID as the external ID when creating the Cross Account IAM role. This enhancement also removes the External ID field from the AWS IAM Role account.

  • eXtreme Azure Databricks Account: Enhances the eXtremeplex-level Azure Databricks account to support account validation. Validating an account before applying the account settings enables you to verify the account's configuration.

Updated Snap Packs

  • Spark SQL 2.x Snap Pack: Enhances multiple Snaps to support Snap suggestions for the file or directory path. You can click  to retrieve a list of available file names, based on your account configuration. The following Snaps have the new suggest functionality:
  • eXtreme Snap Packs now support account validation. Thus, you can click Validate in the account settings dialog to validate that your account is configured correctly. 

Known Issues

  • (This issue is fixed on December 01, 2020)  When you work with Redshift database tables, using SQL expressions in the ELT Transform Snap results in an [Amazon](500310) Invalid operation error.

  • Azure Data Lake Storage Gen 2 OAuth2 accounts fail to validate with an SLDB Extreme Account Validator service failed error.

  • (This issue is fixed on November 26, 2020) When you work with PySpark Script or JAR Submit Snaps, ensure that the JAR files are also present in the artifact bucket even if the corresponding Snap accounts exist. Else, the Snaps fail with a Provided input script doesn't exist error. 

Prior 4.22 eXtreme Dot Releases are Merged into 4.23 GA 

 Click here to expand...

Snap PackDateSnaplex BuildUpdates
 
 422patches6845Fixes an issue in the Parquet Formatter Snap where the partitioned sub-folders are not organized in the order of the keys in the Partition by field.