September 2024 Release Notes

Highlights

The SnapLogic September 2024 Release includes the following highlights:

Admin Manager

  • Changed category names on the left navigation pane

GenAI App Builder

  • Added the Add Message, Create and Run Thread, Create Thread, and Run Thread Snaps to the Azure OpenAI LLM Snap Pack

Monitor

  • Usability improvements to the System overview and Metrics pages

Snaps

  • Added the Reltio OAuth2 Account that authenticates the user via the Client credentials Grant type

  • Added the Google Service Account to connect Google Sheets Snaps to a data source


Upgrading to this Release

The mandatory automatic Snaplex upgrade is scheduled at 3 PM (Pacific Daylight Time) on Saturday, Sep 28, 2024 per the SnapLogic Release calendar. Snaplexes already on the prior recommended version are not impacted. Learn more.

Dot Releases: Platform

To take advantage of the following fixes, upgrade the Snaplexes in your environment (Org) to the recommended version.

Date

Component

Version

Fixed Issues

Date

Component

Version

Fixed Issues

Oct 11, 2024

Snaplex

4.38.1.2_restricted-27573 - 4.38 Patch 3

  • The Catalog Delete Snap didn’t work after the September release.

  • When you call Proxy endpoints with empty response payloads, the call correspondingly returns an HTTP 204 or 205 error codes. Previously, the request would fail with a null_map error message.

This Snaplex version is not the recommended version, and only customers affected by these issues should use it.

Sep 17, 2024

Snaplex

main-27019 4.38 Patch 1 (Recommended)

  • A Snaplex-level date locale reference caused Scheduled Tasks to fail when date strings with non-ASCII characters or 3-letter abbreviations were referenced.

  • The Script Snap stopped working with the 4.38 GA Snaplex version for scripts that use the HMAC or urllib libraries, producing the following error:
    Cannot make memory view because object does not have the buffer interface

  • The Compare Pipeline action in Designer was not reporting the same results for two pipelines, regardless of which was chosen as the target.

  • The Catalog Insert Snap was not adding data to Tables in Manager created with the data catalog service.

  • After the June release, there was a delay in the response time when you called a Triggered Task on a Groundplex using the Cloud URL with a payload of 26 MB or larger.

Dot Releases: Snaps

Snap Pack

Date

Snap Pack Version

Updates

Snap Pack

Date

Snap Pack Version

Updates

Amazon S3

Oct 15, 2024

438patches28445

Enhanced the S3 Download Snap with an Enable Staging checkbox that enables you to download an S3 object into a local temporary file. This enhancement addresses the cases where certain downstream Snaps take longer to process large volumes of data, potentially causing a connection reset error and pipeline failure.

API Suite

Oct 8, 2024

438patches28365

  • The GraphQL Client Snap now includes an improved error-handling mechanism that emulates how the errors are reported in the raw GraphQL response. This enhancement provides additional context and pagination to the error output, which was previously limited to one page. Learn more.

  • Enhanced the GraphQL Client Snap with the Include extensions checkbox to support extensions that enable you to access query content and extension data in a structure, similar to the GraphQL response. The non-standard fields in the GraphQL response are now ignored to avoid a possible error.

OpenAI LLM

Oct 8, 2024

438patches28389

Added the following Snaps to the OpenAI LLM Snap Pack:

Microsoft Dynamics 365 for Sales

Oct 8, 2024

438patches28424

Fixed an issue with Dynamics 365 for Sales Update and Upsert Snaps where the HTTP headers were not part of the REST Batch API call when the Batch Size exceeded 1. The Snaps now include those HTTP headers in the Batch API calls.

SAP

Oct 4, 2024

438patches28277

Fixed the SAP IDoc Listener and SAP IDoc Document Listener Snaps as below:

  • The Snaps now interrupt the Snap thread if the JCo server stops.

  • If you attempt to open and modify the Ultra pipeline with the SAP iDoc Listener Snaps in the Designer, the pipeline restarts (the existing Ultra pipeline stops).

Amazon Bedrock LLM

Sep 30, 2024

438patches28276

Fixed an issue with the following Snaps that resulted in a Malformed input request error when processing messages on Windows-based Groundplex machines:

Kafka

Sep 25, 2024

438patches28225

Enhanced the Kafka MSK IAM Account to support Cross Account IAM Access on Amazon MSK Cluster configured through Transit Gateway and multi VPC Peering.

Binary

Sep 23, 2024

438patches28197

  • Fixed an issue with the Binary Snaps that caused intermittent errors on the Groundplex nodes when using the SMB protocol. The errors occurred when multiple IPs were returned for the same address, and one of the IPs was unreachable by the SMB server.

  • Fixed an issue with the Directory Browser Snap where a mount error was displayed if the hostname contained an underscore, resulting in an empty hostname in the SMB URL.

Amazon Bedrock LLM

Sep 20, 2024

438patches28174

Azure OpenAI LLM

Google GenAI LLM

OpenAI LLM

Sep 20, 2024

438patches28155

Enhanced the following Snaps with the Stop sequences field to support specifying stop sequences as a model parameter. You can specify the sequence of tokens or text to indicate to the model when to stop generating text:

OpenSearch

Sep 20, 2024

438patches28124

Removed the Validate button for the OpenSearch Account.

NetSuite REST

Sep 18, 2024

438patches28114

Fixed an issue with the NetSuite REST Snaps where account IDs containing underscores ('_') were not correctly interpreted, which is crucial for endpoint URL calculation.

JDBC

Sep 18, 2024

438patches28052

Fixed a connectivity issue with the Generic JDBC Snaps that resulted in an error when connecting the JDBC account to a Sybase database using the jConnect driver.

Breaking change:

Your existing pipelines that use the JDBC Snaps to integrate with Oracle or Redshift databases using the bundled Oracle or Redshift JDBC drivers will stop functioning with the 438patches28052.
Workaround
You must manually upload the Oracle or Redshift JDBC driver in the JDBC Database account to run your pipelines successfully.
Download the drivers:
OJDBC: Maven Repository: com.oracle.database.jdbc » ojdbc6 » 11.2.0.4
Redshift: Maven Repository: com.amazon.redshift » redshift-jdbc42 » 2.1.0.11

SOAP

Sep 17, 2024

438patches28073

Fixed an issue with the SOAP Execute Snap, where the Snap could not identify the '@' character after the Velocity library upgrade, implemented as part of the August 2024 GA release (main27765).

Transform

Sep 17, 2024

438patches28073

Fixed an issue with the JSON Generator and XML Generator Snaps that caused unexpected output displaying '__at__' and '__h__' instead of '@' and '-' respectively because the Snap could not update them to their original values after the Velocity library upgrade, implemented as part of the August 2024 GA release (main27765).

Admin Manager

Enhancements

  • A new note in the Admin Manager for the Snaplex page in the Downloads tab states that only the latest version download links are available because deprecated versions cannot be used for installation. Learn more

  • The left navigation for Admin Manager is updated:

    • Access SSO configuration from the Authentication item under Security

    • Password expiration settings are now Password expiry

    • Environment and Snaplex settings are now under System configuration instead of General settings

      image-20240909-164341.png

API Management

Enhancement

  • The HTTP Response Cache Policy is renamed the Response Cache policy.

Fixed Issue

  • Git-authenticated users can create API versions from a Git Repository.

AutoSync

Enhancements

  • The new Treat string as text checkbox in the configuration options for MySQL as a target, when selected, sets source columns that map to a common model string type (cdt_string, cdt_nstring, cdt_char, and cdt_nchar) to the MySQL mediumtext data type instead of varchar data type.

Known Issues

  • The 438patches28270 AutoSync Snap Pack correctly maps Zendesk and Generic JDBC source NVARCHAR fields or columns to NVARCHAR. However, for existing target tables, change capture does not detect that existing VARCHAR fields and columns should be changed to NVARCHAR. To apply the fix to existing tables, follow the steps described in the first fixed issue in the next section.

Fixed Issues and Behavior Changes

  • For Zendesk and Generic JDBC sources, NVARCHAR fields or columns now load in the target correctly. To apply this fix:

    1. Upgrade data pipelines with Zendesk or Generic JDBC sources to use the 438patches28270 AutoSync Snap Pack.

    2. Do one of the following:

      1. Edit the appropriate data pipelines to use Full load, which drops the tables and reloads them. If necessary, change to Incremental or SCD2 after the first load.

      2. Leave the load type as Incremental or SCD2 and manually drop the appropriate tables in the target.

  • Merge column transformations no longer fail if the merged column size exceeds the precision of the target. The fix introduces a behavior change:

    • When any of the source columns selected for a merge don't have a set precision, AutoSync sets the new column to the target's maximum precision.

    • When all source columns selected for a merge have a set precision, AutoSync uses their value up to the target's maximum precision.

  • Selections in the Mask data transformation are now applied correctly when saved.

Documentation Enhancements

  • Enhanced the Pipeline Execute Snap with added examples and best practices to improve readability and usability.

New Videos

  • Learn how to use SnapGPT and some basic prompts.

    How to Use SnapGPT.mp4
  • Start using Monitor to troubleshoot pipeline executions. Watch a comparison of the Dashboard and Monitor workflow.

GenAI App Builder

New Features

Azure OpenAI LLM: Added the following Snaps:

  • Add Message: Adds messages to an existing thread.

  • Create Thread: Creates a thread by making an HTTP request to the Assistant API.

  • Create and Run Thread: Creates a thread and retrieves the result on a specified assistant.

  • Run Thread: Executes the specified thread and retrieves the result on a specified assistant.

Enhancements

  • Enhanced the Unstructured API Account with the Read timeout (seconds) field that enables the Snap to wait for a response from the Unstructured API.

Monitor

Enhancements

  • Graphs on the Metrics page have an improved design and include new charts for heap memory, non-heap memory, and combined memory in gibibytes (GiB). The following shows the new Combined memory graph.

     

  • The System overview graph and list views now include icons to differentiate JCC and FeedMaster nodes. The following shows a JCC node in the graph view:

Fixed Issues

  • The Monitor Insights page no longer displays statistics as a negative number.

Platform

Known Issues

  • The Dashboard Insights tab displays an empty pie chart for statistics that have a value of under 0.01%.

RFC Compliance Enforcement

Snaps

Upcoming

New Snaps/Accounts

Enhancements

  • SAP S/4HANA:

    • Enhanced the SAP S/4HANA Read and Read Custom Query Snaps now include the Raw response checkbox. Select this checkbox to output the raw response as a single document. If you clear the checkbox, the results are written as individual documents.

  • SAP SuccessFactors:

Behavior change

In JCo 3.1.4, if a decimal number couldn't be stored in a BCD field, it was rounded, resulting in a loss of precision. This behavior was removed in JCo 3.1.9, and instead, a conversion error is raised when this condition is detected. Here's an example of a conversion error:
Cannot convert value '1035.1532177250149'
from type java.math.BigDecimal to type BCD field ZINV_AMT in record ZINVENTORY

Note from SAP documentation mentioned in SAP Note 3446411 (Version: 4, Released On: 04.04.2024):

This happened at calling API method JCoRecord.setValue([name|index], BigDecimal) for a type BCD field or parameter, if the fraction part of the provided java.math.BigDecimal value had too many digits to fully fit into the BCD field. In this case, the provided BigDecimal value was unintentionally rounded instead of throwing an appropriate ConversionException for notifying the caller about the value not fitting into the BCD field. Hence, there might have been an unnoticed loss of precision.

Workaround:

Before passing the parameter value to SAP, modify the value by rounding or truncating to ensure it fits into the target BCD field.

SnapGPT

Enhancements

  • Enhanced design for selecting pipeline examples to generate pipelines.