November 2023 Release Notes

Highlights

The SnapLogic® November 2023 Release includes the following:

Admin Manager

  • Manage allowlists for Groundplexes with an easy-to-use interface

  • Configure pipeline validation and the number of documents displayed in Snap data previews

API Management

  • View the API catalog and documentation without logging in to the Developer Portal

  • Introduced new API policies:

    • JWT Validator Policy authenticates users with a token

    • TLS Outbound Policy supports using certificates for client and server communication

AutoSync

  • New destination endpoints: on-premises Oracle and on-premises SQL Server

  • New source endpoint: Google Analytics 4

  • Synchronize a subset of table data

Platform

  • Cloudplex Secure Connectivity with AWS Private Link enables Cloudplexes to communicate with AWS and on-premises data sources

Snaps

  • Introduced the NetSuite REST Snap Pack:

    • NetSuite REST Read

    • NetSuite REST Execute

    • NetSuite REST Search

    • NetSuite REST Access Token Account

    • NetSuite REST M2M OAuth2 Account

  • Added the Google Service Account to the HTTP Client Snap

The JDBC driver for the Oracle Snap Pack is upgraded from OJDBC6 JAR (v11.2.0.4) to OJDBC10 JAR (v19.20.0.0) in the stable distribution in the November 2023 release (after the Snaplex upgrade). This upgrade changes specific error codes and status messages. The latest JDBC driver upgrade is backward-compatible. Learn more about upgrading from Oracle JDBC 11.2.0.4 driver to 19.20.0.0 driver.

SnapGPT

  • Improved support for generating SQL queries with a new SQL editor preview panel in the Designer

Dot Releases - Platform

Date

Feature

Description

Date

Feature

Description

Nov 21, 2023

Snaplex version: main-21368 - 4.35 Patch 1 (Recommended)

Fixed an issue where using expressions to reference accounts did not work.

Nov 10, 2023

Admin Manager

The Groundplex allowlist tab contains updated text. Previously, two labels incorrectly referred to Tasks. The screenshot below this table shows the corrected labels.

Groundplex allowlist

Git Integration

Fixed an issue where users received a 500 status authenticating with Git even though the App Gateway was correctly configured.

Dot Releases - Snaps

Snap Pack

Date of Update

Snap Pack Version

Updates

Snap Pack

Date of Update

Snap Pack Version

Updates

PDF

Dec 13, 2023

435patches24256

  • Introduced the PDF Snap Pack, which contains the following Snaps:

    • PDF Formatter: Enables you to format an input document as an output PDF document

    • PDF Lock: Password-protects a PDF document to prevent unauthorized access to the PDF file

    • PDF Merger: Merges multiple PDF documents into a single PDF document

    • PDF Parser: Extracts text, images, or tables from a PDF document from any upstream binary source

    • PDF Splitter: Splits a single PDF document into multiple PDF documents

    • PDF Unlock: Removes password protection from PDF files

API Suite

Dec 11, 2023

435patches24208

Fixed an issue with the HTTP Client Snap that caused incorrect parsing of the boundary parameter by some REST endpoints. If you need to specify a character set, enter it in the individual parts of the request, as the charset parameter has been removed from the multipart content-type.

Salesforce

Dec 8, 2023

435patches24006

Enhanced the Salesforce Read Snap by adding expression enablement to the following checkboxes:

  • Use PK chunking if supported

  • Include Deleted Records

SAP

Dec 4, 2023

435patches24068

  • Enhanced the SAP IDoc Listener and SAP IDoc Document Listener Snaps with a new Halt on SAP error checkbox for better error-handling capability. Select this checkbox to enable the listener to interrupt and halt processing in case of an error from SAP.

  • Removed the unnecessary spring-core dependency from the SAP Snap Pack.

Transform

Dec 4, 2023

435patches24094

Fixed a deserialization issue for a unique function in the Aggregate Snap.

Splunk Snap Pack

Nov 30, 2023

435patches24034

  • Fixed an issue with Splunk Saved Search Snap that displayed a null point exception when an invalid Saved search name was configured.

  • Updated the documentation URLs for the Snaps in the Splunk Snap Pack. Refer to the Splunk Snap Pack for the latest and current documentation.

API Suite

Nov 21, 2023

435patches23943

Fixed an issue with the GraphQL Client Snap that displayed a null pointer exception when the Header authenticated checkbox in the OAuth2 Account is deselected. The Snap now passes the credentials appropriately using URL parameters when the Header authenticated field is deselected.

HubSpot

Nov 20, 2023

main156

Added the HubSpot Private App Account to the HubSpot Snap Pack.

Oracle

Nov 20, 2023

435patches23823

  • Fixed an issue with the Oracle-Stored Procedure Snap that displayed an error (SnapDataException) when custom JAR files were used in the Oracle Accounts.

  • Fixed an issue with the Oracle-Stored Procedure Snap that displayed an error when custom JAR files were used for BLOB and CLOB datatypes in the Oracle Accounts.

Hadoop

Nov 20, 2023

435patches23904

  • Fixed an issue with the Parquet Writer Snap that displayed an error Failed to write parquet data when the decimal value passed from the second input view exceeded the specified scale.

  • Fixed an issue with the Parquet Writer Snap that previously failed to handle the conversion of BigInt/int64 (larger numbers).

PostgreSQL

Nov 16, 2023

435patches23831

Fixed an issue with the PostgreSQL-Execute and PostgreSQL-Select Snaps that added escape characters ('\\') in the output for JSONB datatype.

Hadoop

Nov 15, 2023

435patches23780

Fixed an issue related to error routing to the output view. Also fixed a connection timeout issue.

Binary

Nov 13, 2023

435patches23780

Fixed an issue with the Binary Snaps that failed to build a data connection when connecting to the FTP server over FTPS protocol.

Data Automation

ELT

Nov 8, 2023

435patches23671

  • With Databricks Lakehouse Platform as the target CDW, you can now define your update expressions with the WHEN NOT MATCHED BY SOURCE clause besides other supported clauses and expression lists in the ELT Merge Into Snap.

Upgrading to this Release

  • To use the new SnapLogic features and Snaps in the current GA release, ensure that your Snaplex nodes are upgraded to the recommended version.

  • This release includes stable versions of the monthly Snap patches deployed to the SnapLogic Platform after the August 2023 release, as listed in the Dot Releases section of the September and October Release Notes.

  • Per the SnapLogic Release calendar, all remaining Snaplexes across Orgs will be upgraded to the recommended version (main-21799 - 4.35 Patch 3) during the automatic upgrade, scheduled for 3 PM (Pacific Standard Time) on Saturday, Jan 13, 2024. Orgs that were migrated to the current GA release before the automatic upgrade are not impacted. For information on how to upgrade your Snaplex, refer to the SnapLogic Release Process.

  • The SnapLogic GA release build that is on the production server is also deployed on the UAT server.

Admin Manager

Features

  • Introduced a user-friendly interface, which helps admins manage a Groundplex IP address allowlist:

     

  • Control pipeline validation in the environment from the new Pipeline validation screen. With validation enabled, Environment admins can set the maximum number of documents that Snaps display in the data preview. With validation disabled, data preview is not available.

Enhancements

  • Input values directly as an alternative to using the sliders on the Session timeout and the Password expiration screen:

     

  • The dialog for creating a new service account now provides a radio button for selecting a role. Learn more about roles.

     

  • The New user screen now includes a toggle for password-based authentication. Learn more.

Fixed Issues

  • Delete a group from the table on the Groups screen. Hover on the right side of a row to display the Delete link:

  • Change a user’s role by editing their account.

API Management

Features

  • View the API catalog and API documentation without logging in to the Developer Portal by enabling the Allow access without login checkbox under the Settings tab in the Portal Manager.

     

  • The JWT Validator API policy authenticates a request with a Java Web Token (JWT). When this policy is applied, API consumers must use their credentials to sign their JWT. If the token is invalid, the request is not processed.

     

  • The Outbound TLS API policy ensures that outbound endpoints are verified by TLS certificates during API processing. When a client calls a Proxy API with this policy, the server and client exchange certificates.

Enhancements

  • Org admins can now grant users full access to publish, unpublish, deprecate, and retire Proxies and APIs by enabling the Allow Full-Access users to publish checkbox in Portal Manager > Settings page.

Fixed Issues

  • Fixed an issue where the API Dashboard displayed incorrect data because a Snaplex node pushed the same data multiple times to the control plane.

AutoSync

Features

  • New destination endpoints:

  • New source endpoint: Google Analytics 4

  • The option to synchronize a subset of table columns or object fields provides the following benefits:

    • Save costs by storing only necessary data

    • Filter out data that is unrelated to the business objective

    • Exclude sensitive data

The data pipeline wizard Filter columns screen previews up to four rows of data from each selected table. Click a column to remove it from the integration. In this release, you can only filter columns when creating data pipelines, not when editing them. Learn more.

Enhancements

  • Data pipelines with Google BigQuery as a source can now use Incremental or SCD2 as a load type.

Fixed Issues

  • For the SFTP endpoint, Binary Two-factor Auth Accounts created in the IIP now work correctly.

  • You can now select a Groundplex for on-premises targets when creating a data pipeline. This Groundplex connects to the on-premises data sources and on-premises destinations in the integration, so it needs to have access to both source and destination subnets/network ranges.

  • Special characters in user names no longer cause an issue with Accounts created in the IIP.

Known Issues

  • For integrations that load from Google BigQuery to BigQuery, failures can occur if a source BIGNUMERIC column does not have precision and scale set and contains a value with precision larger than 76. This happens because when the precision and scale for a BIGNUMERIC column is not set in the source, AutoSync sets it to (76,38) when creating the target table. BigQuery can actually store a BIGNUMERIC value with a precision and scale of (76.76,38).
    Workaround: Set the precision and scale for BIGNUMERIC columns in the source to (76,38).

  • For integrations with Google BigQuery as a source or destination, the Filter columns data preview might not contain data, so there is no way to select the columns that you do not want to synchronize.
    Workaround: The issue is intermittent. Try re-creating the data pipeline.

  • Clarification to documented behavior: When using the Append load type for CSV files, if you upload a file containing content that was previously uploaded, the content is duplicated in the destination. This is because CSV files do not have primary keys to distinguish the data.

  • For efficiency and performance, AutoSync uses bulk load for Salesforce objects. The Salesforce Bulk API does not support all object types. Refer to the Salesforce discussion forum for more information.

Data Automation

Enhancements

  • Enhanced the ELT Merge Into and ELT SCD2 Snaps to display detailed pipeline execution statistics about the data loaded to target tables on a Databricks Lakehouse Platform instance. In addition to the individual counts of rows inserted, updated, and deleted that the ELT Merge Into Snap covers, the ELT SCD2 Snap also reports the count of source rows rejected.

Platform

The Dashboard Lineage tab is discontinued in the November 2023 release.

Features

  • Cloudplex Secure Connectivity with AWS Private Link enables Cloudplexes to communicate with AWS and on-premises data sources. The New connection wizard simplifies the configuration process, and the Cloudplex Secure Connectivity screen provides an easy way to monitor connections and their statuses. You can create up to 3 connections for each of your Cloudplexes. This beta feature provides a way to take advantage of Snaplexes managed by SnapLogic to run your pipelines to endpoints in the public cloud. Your Environment must have this subscription enabled.

Enhancements

Fixed Issues

When using the Git integration, sometimes Tasks were showing as locally modified when no changes were made.

Behavior Changes

  • Increased control over whether pipeline designers can view real data in Snap data previews. Data previews populate during pipeline validation. Previously, Org admins could disable pipeline validation for the Org, but individual users could override that in their User Settings. Now in Admin Manager:

    • If an Environment admin (formerly Org admin) disables pipeline validation, users cannot override the setting and enable data preview.

    • If pipeline validation is enabled, an Environment admin can limit the number of documents shown in data previews. Users can customize their personal User Setting up to the maximum number selected by the Environment admin. Learn more.

Snaps

Behavior Changes

New Snaps and Accounts

Enhancements

SnapGPT

  • Improved support for generating SQL queries with a new SQL editor preview panel in the Designer.

  • Improved overall quality of generated results for all features:

    • Pipeline description

    • Pipeline generation

    • Expression generation and mappings for the Mapper Snap

    • SQL query generation

    • Q&A using the SnapLogic documentation knowledge base

Documentation Enhancements

New Video

Enhancements