June 2024 Release Notes

Highlights

The SnapLogic June 2024 Release includes the following highlights:

Admin Manager

  • Environment admins can now configure user and team accounts to log in with multi-factor authentication (MFA)

AutoSync

  • Enhancements to the merge columns transformation interface

  • Connect to any endpoint with a Groundplex

Documentation Updates

  • New video tour of SnapLogic Monitor

  • Added FAQ document for API Management solution

GenAI Builder

  • Added the OpenSearch Snap Pack

Monitor

  • New Activity log event to track enabling and disabling pipeline validation at the project level

  • New Snaplex node and pipeline execution statistics

Platform

  • New public API to check the pipeline quality

Snaps

  • Added NetSuite Get Server Time Snap to the NetSuite SOAP Snap Pack

  • Added File Password Account to the Binary Snap Pack

  • Added Kafka OAuth2 Account to the Kafka Snap Pack

  • Added Kerberos authentication support for Oracle databases on Windows and Linux systems

SnapGPT

  • New discovery skills workflow to facilitate user journeys

Dot Releases - Platform

Date

Component

Version

Description

Date

Component

Version

Description

Jun 18, 2024

APIM - API Suite Snap Pack

437patches26826

Updated the API Suite to support the SSL account type with API Versions and Proxies. This enables sending the client data as basic auth headers, rather than in the body of the request, leveraging the same property name as other OAuth2 accounts.

Jun 14, 2024

APIM - Policies Snap Pack

 

437patches26674

Added support for the OAuth2 SSL Account.

Jun 12, 2024

Snaplex

main-24960 - 4.37 Patch 2

Snaplex version for the June Release.

May 22, 2024

Snaplex

main-24517 - 4.37 Patch 1

Fixed an issue with the Ultra task, where the presence of a special character in the Ultra task label resulted in an error.

Dot Releases - Snaps

Snap Pack

Date of Update

Snap Pack Version

Updates

Snap Pack

Date of Update

Snap Pack Version

Updates

Unstructured

Jul 9, 2024

437patches26999

Introduced Unstructured Snap Pack that enables seamless integration with the Unstructured API to extract structured data from raw unstructured documents. It transforms the provided data to inject into your application, data, and other generative AI needs. It contains the following Snap and Account:

  • Partition API: Extracts structured data from raw unstructured documents using the Unstructured API and transforms it into structured data.

  • Unstructured API Account: Authenticates with Unstructured API using the specified credentials.

Adobe PDF

Jul 9, 2024

437patches27004

Introduced Adobe PDF Snap Pack that enables you to integrate PDF functionalities into applications using Adobe’s REST APIs. It contains the following Snaps and Account:

  • Extract: Extracts text, table, and figures from a PDF file.

  • OCR: Adds a scannable layer on top of an image-based PDF file.

  • Adobe Account: Authenticates with Adobe APIs using the specified Client ID and Client secret.

OpenAI LLM

Jul 9, 2024

437patches27021

Enhanced the OpenAI Chat Completions Snap with Advanced prompt configuration field set that enables the Snap to parse JSON objects to include them in the output and configure system prompts to guide the responses or actions

Azure OpenAI LLM

Jul 9, 2024

437patches27098

  • Updated the API version for the Azure OpenAI LLM Snap Pack from 2023-05-15 to 2024-02-01.

  • Enhanced the Azure OpenAI Chat Completions Snap with Advanced prompt configuration field set that enables the Snap to parse JSON objects to include them in the output and configure system prompts to guide the responses or actions.

Amazon Bedrock LLM

Jul 9, 2024

437patches27098

  • Enhanced the Amazon Bedrock Account with IAM Role and Cross-Account Access role support for enhanced security, scalability, and automation.

  • Enhanced the Anthropic Claude on AWS Messages Snap with Advanced prompt configuration field set that enables the Snap to parse JSON objects to include them in the output and configure system prompts to guide the responses or actions.

SQL Server

Jul 5, 2024

437patches27091

Fixed a case-sensitivity issue with the SQL Server—Bulk Load Snap that caused a NullPointerException when retrieving the PATH environment variable in a Windows environment. This change is applicable only to Windows, as environment variables are case-sensitive in Linux.

Binary

Jun 28, 2024

437patches26873

Fixed an issue with the File Poller Snap where the Snap applied a case-sensitive filter in the Windows operating system.

Vertica

Jun 28, 2024

437patches26900

The jOOQ library for Vertica Snap Pack is upgraded from v3.9.1 to v3.17.x. This upgrade will be part of the GA release on August 14, 2024 (Stable release). Learn more.

Snowflake

Jun 27, 2024

437patches26821

  • Added Snowflake - Vector Search Snap to enable advanced vector-based queries as part of the Select statement.

  • Enhanced the Snowflake Snap Pack with full vector support, including schema generation and output compatibility with vector data types.

ELT

Jun 24, 2024

437patches26846

Fixed the issue with the ADLS Gen 2 account connection where some conflicts between internally used Azure libraries prevented the ELT Load Snap from reading files.

  • Fixed an issue with the ELT Merge Into Snap where the Snap’s SELECT SQL statement could not fetch the target tables information from the PG_TABLE_DEF catalog table of the Amazon Redshift instance.

  • The SELECT SQL statement now uses lowercase for both non-delimited and delimited table names and excludes double quotes from delimited table names to fetch the values from the catalog table.

PG_TABLE_DEF is a Redshift system catalog table that contains information about the tables including table names, column names, data types among their other metadata.

Enhanced the ELT Load Snap to support loading data from nested AVRO, JSONLines, ORC, or Parquet files in Azure storage to the target tables in a Databricks Lakehouse Platform (DLP) instance. Only two Load actions are supported: Drop and create table and Append table.

NetSuite SOAP

Jun 24, 2024

437patches26823

In a specific scenario where the body is absent in the SOAP request, the NetSuite Search Snap reloads the envelope to prevent the Snap from erroring out.

MongoDB

Jun 24, 2024

437patches26832

Fixed the inconsistency in ObjectId and Date representation in the output preview between MongoDB - Execute and MongoDB - Find snaps.

Enhanced the MongoDB Execute Snap with the Timezone Offset field set that enables you to apply the timezone offset on the date fields.

API Suite

Jun 24, 2024

437patches26862

Fixed an issue with the HTTP Client Snap where redirect URLs containing spaces were not properly encoded, resulting in runtime errors.

API Suite

Jun 18, 2024

437patches26826

Enhanced the SSL OAuth2 Account with the Send Client Data as Basic Auth header checkbox that enables you to send the client information as a header to the OAuth endpoint.

SAP Concur

Jun 13, 2024

main175

Fixed the documentation links for SAP Concur Snap Pack.

Sharepoint Online

Jun 13, 2024

main175

Admin Manager

New Feature

  • In environments subscribed to multi-factor authentication (MFA), Environment admins can now configure user and team accounts to log in with MFA. Learn more.

    enable-mfa.png

API Management

Enhancements

Known Issue

  • When you create an API Proxy with the API Suite Outbound OAuth2 policy and call the Proxy endpoint with basic auth credentials, the authentication fails with a 400 error (bad request).

AutoSync

Enhancements

  • You now have the option to connect to any endpoint with a Groundplex:

    • Select a Groundplex or the AutoSync Snaplex when selecting a target in the wizard or when editing a data pipeline.

    • The Groundplex must have connectivity to all endpoints in the data pipeline. Learn more.

  • Merge columns in the data pipeline wizard and the edit screen have two usability enhancements. The following highlights the changes in the edit screen:

    as-transform-overlay-buttons.png

    • Columns selected to merge display in an overlay on the right side, making it easier to navigate the preview and choose other columns.

    • Cancel and save actions are now available below the merge configuration. This clearly separates the controls to cancel or save a single merge from the buttons to cancel or save all configured merges.

Known Issues

  • The merge column preview doesn’t update correctly when you drag the column names to reorder the data. When you save the merge, the new column reflects the correct order.

  • A new merged column can fail to load because of the name’s case. For example, for a Snowflake target, until this issue is fixed, the name must be uppercase and for a Redshift target, the name must be lowercase.
    Workaround: If a merged column fails to load, try changing the case of the name.

Documentation Updates

API Management Enhancements

  • Updated the OAuth 2.0 Client Credentials Policy with the OAuth2 framework for the client credentials grant type. Learn More.

  • The FAQ document for the API Management solution is now available. Learn More.

Content Published on New Doc Site

  • The first version of a new Introduction section, designed for new SnapLogic users, contains workflow and architectural concepts and links to existing content for more details.

Video

Watch how to navigate Monitor to analyze, review, and observe activity in your SnapLogic environment.

Watch the Integration Catalog video to know more about it.

GenAI Builder

Introduced the OpenSearch Snap Pack, which contains the following Snaps and Account:

  • OpenSearch Query: Executes a query on the specified OpenSearch index.

  • OpenSearch Upsert: Performs an operation that updates existing records if they exist, or inserts new records if they don't.

  • OpenSearch Account: Authenticates with OpenSearch services using the specified AWS account credentials.

Monitor

New Features

  • A new Node diagnostics table shows the maximum, minimum, recommended, and current values for configurable parameters to help you maximize Snaplex node performance and avoid issues. It also shows average and peak RAM usage.
    In the System overview, click a Snaplex node to open its details panel. Click the Additional details tab to view the table. Entries in red in the Current value column highlight settings that do not meet the recommendation:

    Activity logs now include project-level events such as pipeline validation events. You can filter the log by Project events. Learn more.

Enhancements

Monitor enhancements include:

  • The Insights page now opens first when you navigate to Monitor. The calendar can be set to show statistics for the last year. Previously, the limit was six months.

  • You can now stop a running execution or restart a resumable pipeline from the Execution overview page. The following shows the Stop pipeline option on the execution row Actions menu:

  • The details panel for a pipeline execution now includes a link to open the pipeline in Designer, the Task Name, and two new fields:

    • Slot—Snaplex nodes are configured with a maximum number of slots, or allocated memory spaces. Each Snap uses a slot to execute. This is the count of the number of slots used by the pipeline.

    • Resumable—Indicates whether the Resumable subscription feature is enabled for a pipeline.

  • The new State Transition tab in the pipeline execution details panel updates with a timestamp when the pipeline transitions from the prepared to the completed state:

  • The details panel for an Ultra Task pipeline includes two new fields:

    • Max-in-flight—The threshold for the number of documents a single node processes. When the execution reaches the threshold, the Snaplex distributes requests to other nodes. The threshold value is set in Ultra Task configuration options.

    • Close reason—When an Ultra Task transitions to completed status, the close reason can be one of the following:

      • Reference no longer exists or is inaccessible

      • Host Snaplex node restarted

      • The Ultra task has been updated

      • The task is no longer active

      • Closing Ultra pipeline instance to balance instances across the Snaplex

  • The node details panel now includes alerts:

  • The details panel for Snaplex FeedMaster nodes reports two new values, Request storage used and Request storage limit. Requests waiting to be processed are queued and stored on disk. For Groundplexes, you can configure the storage limit for the queue.

  • The Infrastructure page Node list view now includes the Snaplex name.

  • In Activity log events and messages, all occurrences of the terms organization and Org have been replaced with the term environment.

Fixed Issues

  • With the Execution overview table grouped by Task or Pipeline, if you select a date range for more than one week's data, the Execution table now returns the complete results.

Known Issues

  • On the Execution Overview page, one of the advanced search filters does not behave as expected. With Regression Pipeline set as the Invocation type, the table displays the correct results, but the summary card counts do not update.

  • On the Activity log page, when you click a link in the event description, the table should update to show only events that contain the same link. Currently, the URL updates with the link, but the table doesn’t apply the filter.

Platform

Project-level pipeline execution behavior change coming in the July 10 release

Currently, tasks stored in a Project Space of an Org can be executed by pipelines in a different Project Space or even from requests from a different Org. Starting with the July 10 release, tasks must belong to the same Project Space as the pipeline Project Space they are called from to execute successfully.

New Features

  • The new public API for pipeline quality provides a complete report for all standard checks, including message levels, with actionable message descriptions. Learn more.

Enhancements

  • The Dashboard Activity Log has been updated to include a new Project tab. This tab allows you to view project-level pipeline validation events and track the enabling and disabling of pipeline validation. Learn more.

  • The OAuth2 accounts for API Suite, and the REST Snap Packs introduce a new runtime_path_id attribute. The token refresh process will be directed to any node within the specified Snaplex when this parameter is used. Learn more.

  • Customers subscribed to Multi-factor authentication (MFA) can now enable it in more than one environment. Environment admins enable MFA per user account per environment. When users log in with MFA, they will be able to access all environments where they have an account, regardless of whether MFA is enabled for them in all of the environments. After MFA is enabled for a user in any environment, they cannot log in to any environment without providing the extra factor, even if the environment isn’t subscribed to MFA. Learn more.

  • Customers subscribed to Single Sign On (SSO) can now configure a different identity provider (IdP) for each environment. If different environments have different IdPs, a user who logs in with SSO can only access the environments configured for the IdP they are authenticated with when they log in. For example, if Environment A is configured for Okta and Environment B for Entra ID, a user signed into Entra ID can only access Environment B when they log in. To access Environment A, they need to log out of Entra ID and log in to Okta. Learn more.

  • Now deleted files go into the Recycle Bin where they can be retrieved or permanently deleted for up to 30 days by the person who uploaded them or by an Environment admin. The Recycle Bin removes assets permanently after 30 days. Learn more.

Known Issues

  • When an OAuth2 token refresh is successful, the Global Activity Log shows admin@snaplogic.com in the Updated By field instead of the email of the user who owns the account.

  • Clicking the Configured Snap tab in Global Search closes the Global Search window.
    Workaround: Click on the All tab for search results.

  • When creating a Task and selecting the America/Mexico City time zone, the task runtime is off by one hour. Since Mexico City no longer observes daylight savings, the current implementation of CDT (aligned with CST) might assume that Mexico City changed time zones as it did in the past.
    Workaround: Upgrade your Snaplex to a JDK 11.0.18+ version.

  • When making a commit, the changes to the modified asset are committed, but the status incorrectly displays Tracked, modified locally.
    Workaround: Refresh the page or click Update Git status.

Snaps

  • The Snaps mentioned in this section are deployed on the Latest distribution type. To access the updated Snap Packs, an Org admin must select the Snap Pack version in Manager > Snap Packs.

  • The runtime libraries supporting the Script Snap Pack were upgraded as part of the Snaplex release on June 12, 2024. We recommend you download the JCC version main-24960 - 4.37 Patch 2 after the June release and test the pipelines to ensure they perform as per your requirements.

Upcoming

jOOQ Upgrade for the JDBC Snap Pack:

  • We plan to upgrade the jOOQ library of the JDBC Snap Pack from v3.9.1 to v3.17.x on September 11, 2024 (Latest release). This upgrade will be part of the GA release on Nov 13, 2024 (Stable release). Pipelines using the Generic - JDBC Snaps might be impacted after the jOOQ upgrade because the latest jOOQ version is not fully backward-compatible. We will provide more information about the potential impact on your pipelines in an upcoming release.

New Snaps/Accounts

  • Added a new Snap to the NetSuite SOAP Snap Pack:

    • NetSuite Get Server Time: This Snap enables you to get the NetSuite server time in GMT, regardless of the user's time zone.

  • Added the File Password Account to the Binary Snap Pack to support the encrypted and unencrypted ZIP and 7z files.

  • Added the Kafka OAuth2 Account to the Kafka Snap Pack to enable the use of OAuth in the Kafka SASL_SSL and SASL_PLAINTEXT framework.

Enhancements

  • Added expression support to the Skip lines field in the CSV Parser Snap to enable passing pipeline parameters and upstream values. 

  • Enhanced the Decompress Snap to support encrypted and unencrypted ZIP and 7z files through the new File Password Account type.

  • Enhanced the HDFS Writer Snap with the Write empty file checkbox, which enables you to write an empty or a 0-byte file to all the supported protocols that are recognized and compatible with the target system or destination.

  • Added the Number of retries and Retry interval (seconds) fields to MongoDB Atlas Vector Search, Delete, Execute, Find, Group, Insert, and Update Snaps that enable retries during a connection failure.

  • Enhanced the OAuth2 account (for the API Suite Snap Pack) and the REST OAuth2 Account with the Snaplex field for executing OAuth2 operations.

  • Oracle:

    • Enhanced the Oracle Thin and Oracle Thin Dynamic Accounts to support Kerberos authentication for Oracle databases on Windows and Linux systems.

    • Enhanced the Oracle Delete Snap with the Session parameters field set that provides National Language Support (NLS). Learn more.

  • JDBC Driver Upgrades:

    • The PostgreSQL JDBC driver will be upgraded from v9.4.1207 to v42.7.2 (Java 8) on July 10, 2024 to the Latest release. This upgrade will be part of the GA release on August 14, 2024 (Stable release). Learn more

    • The JDBC driver for the Google AlloyDB Snap Pack has been upgraded from v42.4.2 to v42.7.2 (Java 8). This upgrade will be part of the GA release on August 14, 2024 (Stable release). As part of this upgrade, the 42.7.2 JDBC driver is bundled with the AlloyDB Snap Pack as the default JDBC driver. Learn more.

    • Upgraded the JDBC driver for the Snowflake Snap Pack to v3.16.0.

  • The Jython and JRuby libraries for the Script Snap Pack have been upgraded. To ensure compatibility, we recommend that you update your Snaplex to the main-24960 - 4.37 Patch 2 version after the June 12, 2024 release. Test the Script Snap pipelines to verify that they behave as expected.

  • The jOOQ library for the Teradata Snap Pack is upgraded from v3.9.1 to v3.17.3. This upgrade will be part of the GA release on August 14, 2024 (Stable release). Pipelines using Teradata Snaps will not be impacted after the jOOQ upgrade.

Behavior Changes

  • The following are the behavior changes caused by the JDBC driver upgrade for the PostgreSQL and the Google AlloyDB Snap Packs:

    • Some error messages will now include the data type, for example:

      • Old: "...where (badId = 1) was aborted:..."

      • New: "...where (badId = ('1'::numeric)) was aborted:..."

    • There are some minor text changes to a few of the error messages, for example:

      • Old"Hint: No operator matches the given name and argument types."

      • New"Hint: No operator matches the given name and argument type(s)."

Known Issues

Fixed Issues

  • The Azure Service Bus Account exposed the secret key when an illegal connection string exception occurred because of an incorrect string format.

  • The Azure Synapse SQL Select Snap displayed an error and did not retry the connection when the serverless SQL pool was warming up.

  • The COBOL Copybook Parser Snap incorrectly parsed packed decimal numbers.

  • An invalid session-handling issue with the Databricks Snap Pack intermittently triggered an error message when the Snaps failed to connect with Databricks to execute the SQL statement.

  • The GraphQL Client Snap displayed an error when passing the Float data type query variables to the endpoint.

  • The HTML Parser and HTML to Markdown Converter Snaps caused the Snaplex to stall when processing tables.

  • The MySQL-Execute and MySQL-Multi Execute Snaps displayed a null pointer exception when the Snap did not check null table metadata.

  • The Oracle-Execute Snap displayed an error when handling OffsetDateTime type bindings.

  • The Snowflake-Bulk Load and Snowflake-Bulk Upsert Snaps displayed a null pointer exception when the File format type field was left blank or empty.

  • The XML Parser Snap caused an error when using the Splitter option in the Snap settings. 

  • The Google Analytics 4 Create Report and Create Realtime Report Snaps were unable to provide suggestions for the Metrics and Dimensions fields. 

  • The Google Analytics 4 Get Metadata Snap could not display an Unable to get metadata error during validation and execution.

  • The SAP S/4HANA Snap Pack did not support the data type appropriately when the downstream Snaps were used.

  • The PostgreSQL-Execute and Redshift-Execute Snaps produced logs that caused node crashes.

  • The MongoDB—Execute Snap had the data missing when the database server restarted, and the error view was enabled.

  • The MongoDB - Execute Snap log file missed the retry attempts information.

  • The Sort Snap displayed an error when estimating the size of the input document provided by the upstream S3 Browser Snap.

  • The Parquet Formatter Snap was unable to route errors to the error view.

  • The OpenAI Prompt Generator, Azure OpenAI Prompt Generator, and Amazon Bedrock Prompt Generator Snaps displayed an error when handling the mustache operator, {{.}} from the input schema.

  • The S3 Browser Snap could not initialize the output document properly, causing an error in the downstream Snaps.

SnapGPT

Enhancements

  • Skills Discovery: Assists you by presenting a navigation flow to guide you to a better outcome. Each category provides corresponding flows depending on your goal.

  • Pipeline Skills

    • Build pipelines

    • Understand pipeline design

    • View pipeline summaries

  • Contextual Skills

    • Build expressions

    • Define data mappings

    • Build SQL statements

  • Knowledge Skills

    • Learn about SnapLogic

    • Get started