Highlights

The SnapLogic June 2024 Release includes the following highlights:

Admin Manager

• Environment admins can now configure user and team accounts to log in with multi-factor authentication (MFA)

AutoSync

• Enhancements to the merge columns transformation interface

• Connect to any endpoint with a Groundplex

Documentation Updates

• New video tour of SnapLogic Monitor

• Added FAQ document for API Management solution

GenAI Builder

• Added the OpenSearch Snap Pack

Monitor

• New Activity log event to track enabling and disabling pipeline validation at the project level

• New Snaplex node and pipeline execution statistics

Platform

• New public API to check the pipeline quality

Snaps

• Added NetSuite Get Server Time Snap to the NetSuite SOAP Snap Pack

• Added File Password Account to the Binary Snap Pack

• Added Kafka OAuth2 Account to the Kafka Snap Pack

• Added Kerberos authentication support for Oracle databases on Windows and Linux systems

SnapGPT

• New discovery skills workflow to facilitate user journeys

Dot Releases - Platform

Dot Releases - Snaps

Admin Manager

New Feature

• In environments subscribed to multi-factor authentication (MFA), Environment admins can now configure user and team accounts to log in with MFA. Learn more.

  Open

  

API Management

Enhancements

• Added support for API Suite OAuth SSL Accounts in the Outbound OAuth2 Policy. Make sure your Snaplex is on the latest version and that the Policies and API Suite Snap Packs are on the latest distributions.

Known Issue

• When you create an API Proxy with the API Suite Outbound OAuth2 policy and call the Proxy endpoint with basic auth credentials, the authentication fails with a 400 error (bad request).

AutoSync

Enhancements

• You now have the option to connect to any endpoint with a Groundplex:

  • Select a Groundplex or the AutoSync Snaplex when selecting a target in the wizard or when editing a data pipeline.

  • The Groundplex must have connectivity to all endpoints in the data pipeline. Learn more.

• Merge columns in the data pipeline wizard and the edit screen have two usability enhancements. The following highlights the changes in the edit screen:

  Open

  

  • Columns selected to merge display in an overlay on the right side, making it easier to navigate the preview and choose other columns.

  • Cancel and save actions are now available below the merge configuration. This clearly separates the controls to cancel or save a single merge from the buttons to cancel or save all configured merges.

Known Issues

• The merge column preview doesn’t update correctly when you drag the column names to reorder the data. When you save the merge, the new column reflects the correct order.

• A new merged column can fail to load because of the name’s case. For example, for a Snowflake target, until this issue is fixed, the name must be uppercase and for a Redshift target, the name must be lowercase.
  Workaround: If a merged column fails to load, try changing the case of the name.

Documentation Updates

API Management Enhancements

• Updated the OAuth 2.0 Client Credentials Policy with the OAuth2 framework for the client credentials grant type. Learn More.

• The FAQ document for the API Management solution is now available. Learn More.

Content Published on New Doc Site

• The first version of a new Introduction section, designed for new SnapLogic users, contains workflow and architectural concepts and links to existing content for more details.

Video

Watch how to navigate Monitor to analyze, review, and observe activity in your SnapLogic environment.

Watch the Integration Catalog video to know more about it.

GenAI Builder

Introduced the OpenSearch Snap Pack, which contains the following Snaps and Account:

• OpenSearch Query: Executes a query on the specified OpenSearch index.

• OpenSearch Upsert: Performs an operation that updates existing records if they exist, or inserts new records if they don't.

• OpenSearch Account: Authenticates with OpenSearch services using the specified AWS account credentials.

Monitor

New Features

• A new Node diagnostics table shows the maximum, minimum, recommended, and current values for configurable parameters to help you maximize Snaplex node performance and avoid issues. It also shows average and peak RAM usage.
  In the System overview, click a Snaplex node to open its details panel. Click the Additional details tab to view the table. Entries in red in the Current value column highlight settings that do not meet the recommendation:

  Activity logs now include project-level events such as pipeline validation events. You can filter the log by Project events. Learn more.

Enhancements

Monitor enhancements include:

• The Insights page now opens first when you navigate to Monitor. The calendar can be set to show statistics for the last year. Previously, the limit was six months.

• You can now stop a running execution or restart a resumable pipeline from the Execution overview page. The following shows the Stop pipeline option on the execution row Actions menu:

• The details panel for a pipeline execution now includes a link to open the pipeline in Designer, the Task Name, and two new fields:

  • Slot—Snaplex nodes are configured with a maximum number of slots, or allocated memory spaces. Each Snap uses a slot to execute. This is the count of the number of slots used by the pipeline.

  • Resumable—Indicates whether the Resumable subscription feature is enabled for a pipeline.

• The new State Transition tab in the pipeline execution details panel updates with a timestamp when the pipeline transitions from the prepared to the completed state:

• The details panel for an Ultra Task pipeline includes two new fields:

  • Max-in-flight—The threshold for the number of documents a single node processes. When the execution reaches the threshold, the Snaplex distributes requests to other nodes. The threshold value is set in Ultra Task configuration options.

  • Close reason—When an Ultra Task transitions to completed status, the close reason can be one of the following:

    • Reference no longer exists or is inaccessible

    • Host Snaplex node restarted

    • The Ultra task has been updated

    • The task is no longer active

    • Closing Ultra pipeline instance to balance instances across the Snaplex

• The node details panel now includes alerts:

• The details panel for Snaplex FeedMaster nodes reports two new values, Request storage used and Request storage limit. Requests waiting to be processed are queued and stored on disk. For Groundplexes, you can configure the storage limit for the queue.

• The Infrastructure page Node list view now includes the Snaplex name.

• In Activity log events and messages, all occurrences of the terms organization and Org have been replaced with the term environment.

Fixed Issues

• With the Execution overview table grouped by Task or Pipeline, if you select a date range for more than one week's data, the Execution table now returns the complete results.

Known Issues

• On the Execution Overview page, one of the advanced search filters does not behave as expected. With Regression Pipeline set as the Invocation type, the table displays the correct results, but the summary card counts do not update.

• On the Activity log page, when you click a link in the event description, the table should update to show only events that contain the same link. Currently, the URL updates with the link, but the table doesn’t apply the filter.

Platform

New Features

• The new public API for pipeline quality provides a complete report for all standard checks, including message levels, with actionable message descriptions. Learn more.

Enhancements

• The Dashboard Activity Log has been updated to include a new Project tab. This tab allows you to view project-level pipeline validation events and track the enabling and disabling of pipeline validation. Learn more.

• The OAuth2 accounts for API Suite, and the REST Snap Packs introduce a new runtime_path_id attribute. The token refresh process will be directed to any node within the specified Snaplex when this parameter is used. Learn more.

• Customers subscribed to Multi-factor authentication (MFA) can now enable it in more than one environment. Environment admins enable MFA per user account per environment. When users log in with MFA, they will be able to access all environments where they have an account, regardless of whether MFA is enabled for them in all of the environments. After MFA is enabled for a user in any environment, they cannot log in to any environment without providing the extra factor, even if the environment isn’t subscribed to MFA. Learn more.

• Customers subscribed to Single Sign On (SSO) can now configure a different identity provider (IdP) for each environment. If different environments have different IdPs, a user who logs in with SSO can only access the environments configured for the IdP they are authenticated with when they log in. For example, if Environment A is configured for Okta and Environment B for Entra ID, a user signed into Entra ID can only access Environment B when they log in. To access Environment A, they need to log out of Entra ID and log in to Okta. Learn more.

• Now deleted files go into the Recycle Bin where they can be retrieved or permanently deleted for up to 30 days by the person who uploaded them or by an Environment admin. The Recycle Bin removes assets permanently after 30 days. Learn more.

Known Issues

• When an OAuth2 token refresh is successful, the Global Activity Log shows admin@snaplogic.com in the Updated By field instead of the email of the user who owns the account.

• Clicking the Configured Snap tab in Global Search closes the Global Search window.
  Workaround: Click on the All tab for search results.

• When creating a Task and selecting the America/Mexico City time zone, the task runtime is off by one hour. Since Mexico City no longer observes daylight savings, the current implementation of CDT (aligned with CST) might assume that Mexico City changed time zones as it did in the past.
  Workaround: Upgrade your Snaplex to a JDK 11.0.18+ version.

• When making a commit, the changes to the modified asset are committed, but the status incorrectly displays Tracked, modified locally.
  Workaround: Refresh the page or click Update Git status.

• When you call a Triggered Task on a Groundplex using the Cloud URL with a payload of 26 MB or larger, the pipeline processing can exceed the WebSocket connection timeout.
  While the pipeline succeeds in delivering the payload, the bytes after the 26 MB limit might be lost on the response side.
  If the payload is on the request side, then only the first 26 MB of bytes are sent to the pipeline, causing the possibility of pipeline failure.

Snaps

Upcoming

New Snaps/Accounts

• Added a new Snap to the NetSuite SOAP Snap Pack:

  • NetSuite Get Server Time: This Snap enables you to get the NetSuite server time in GMT, regardless of the user's time zone.

• Added the File Password Account to the Binary Snap Pack to support the encrypted and unencrypted ZIP and 7z files.

• Added the Kafka OAuth2 Account to the Kafka Snap Pack to enable the use of OAuth in the Kafka SASL_SSL and SASL_PLAINTEXT framework.

Enhancements

• Added expression support to the Skip lines field in the CSV Parser Snap to enable passing pipeline parameters and upstream values. 

• Enhanced the Decompress Snap to support encrypted and unencrypted ZIP and 7z files through the new File Password Account type.

• Enhanced the HDFS Writer Snap with the Write empty file checkbox, which enables you to write an empty or a 0-byte file to all the supported protocols that are recognized and compatible with the target system or destination.

• Added the Number of retries and Retry interval (seconds) fields to MongoDB Atlas Vector Search, Delete, Execute, Find, Group, Insert, and Update Snaps that enable retries during a connection failure.

• Enhanced the OAuth2 account (for the API Suite Snap Pack) and the REST OAuth2 Account with the Snaplex field for executing OAuth2 operations.

• Oracle:

  • Enhanced the Oracle Thin and Oracle Thin Dynamic Accounts to support Kerberos authentication for Oracle databases on Windows and Linux systems.

  • Enhanced the Oracle Delete Snap with the Session parameters field set that provides National Language Support (NLS). Learn more.

• JDBC Driver Upgrades:

  • The PostgreSQL JDBC driver will be upgraded from v9.4.1207 to v42.7.2 (Java 8) on July 10, 2024 to the Latest release. This upgrade will be part of the GA release on August 14, 2024 (Stable release). Learn more. 

  • The JDBC driver for the Google AlloyDB Snap Pack has been upgraded from v42.4.2 to v42.7.2 (Java 8). This upgrade will be part of the GA release on August 14, 2024 (Stable release). As part of this upgrade, the 42.7.2 JDBC driver is bundled with the AlloyDB Snap Pack as the default JDBC driver. Learn more.

  • Upgraded the JDBC driver for the Snowflake Snap Pack to v3.16.0.

• The Jython and JRuby libraries for the Script Snap Pack have been upgraded. To ensure compatibility, we recommend that you update your Snaplex to the main-24960 - 4.37 Patch 2 version after the June 12, 2024 release. Test the Script Snap pipelines to verify that they behave as expected.

• The jOOQ library for the Teradata Snap Pack is upgraded from v3.9.1 to v3.17.3. This upgrade will be part of the GA release on August 14, 2024 (Stable release). Pipelines using Teradata Snaps will not be impacted after the jOOQ upgrade.

Behavior Changes

• The following are the behavior changes caused by the JDBC driver upgrade for the PostgreSQL and the Google AlloyDB Snap Packs:

  • Some error messages will now include the data type, for example:

    • Old: "...where (badId = 1) was aborted:..."

    • New: "...where (badId = ('1'::numeric)) was aborted:..."

  • There are some minor text changes to a few of the error messages, for example:

    • Old: "Hint: No operator matches the given name and argument types."

    • New: "Hint: No operator matches the given name and argument type(s)."

Known Issues

• The Oracle -Bulk Load Snap does not support Kerberos authentication for Oracle. 

Fixed Issues

• The Azure Service Bus Account exposed the secret key when an illegal connection string exception occurred because of an incorrect string format.

• The Azure Synapse SQL Select Snap displayed an error and did not retry the connection when the serverless SQL pool was warming up.

• The COBOL Copybook Parser Snap incorrectly parsed packed decimal numbers.

• An invalid session-handling issue with the Databricks Snap Pack intermittently triggered an error message when the Snaps failed to connect with Databricks to execute the SQL statement.

• The GraphQL Client Snap displayed an error when passing the Float data type query variables to the endpoint.

• The HTML Parser and HTML to Markdown Converter Snaps caused the Snaplex to stall when processing tables.

• The MySQL-Execute and MySQL-Multi Execute Snaps displayed a null pointer exception when the Snap did not check null table metadata.

• The Oracle-Execute Snap displayed an error when handling OffsetDateTime type bindings.

• The Snowflake-Bulk Load and Snowflake-Bulk Upsert Snaps displayed a null pointer exception when the File format type field was left blank or empty.

• The XML Parser Snap caused an error when using the Splitter option in the Snap settings. 

• The Google Analytics 4 Create Report and Create Realtime Report Snaps were unable to provide suggestions for the Metrics and Dimensions fields. 

• The Google Analytics 4 Get Metadata Snap could not display an Unable to get metadata error during validation and execution.

• The SAP S/4HANA Snap Pack did not support the data type appropriately when the downstream Snaps were used.

• The PostgreSQL-Execute and Redshift-Execute Snaps produced logs that caused node crashes.

• The MongoDB—Execute Snap had the data missing when the database server restarted, and the error view was enabled.

• The MongoDB - Execute Snap log file missed the retry attempts information.

• The Sort Snap displayed an error when estimating the size of the input document provided by the upstream S3 Browser Snap.

• The Parquet Formatter Snap was unable to route errors to the error view.

• The OpenAI Prompt Generator, Azure OpenAI Prompt Generator, and Amazon Bedrock Prompt Generator Snaps displayed an error when handling the mustache operator, {{.}} from the input schema.

• The S3 Browser Snap could not initialize the output document properly, causing an error in the downstream Snaps.

SnapGPT

Enhancements

• Skills Discovery: Assists you by presenting a navigation flow to guide you to a better outcome. Each category provides corresponding flows depending on your goal.