October 2023 Release Notes

Highlights

The SnapLogic® October 2023 Release includes the following:

Admin Manager

  • Added the ability to manage password expiration, session timeout, and SSO configuration

  • Added the ability to manage Snaplex versions and add a Snaplex (Groundplex)

API Management

  • Added support for OpenID Connect

  • The Developer Portal can now be launched from the Resources section of the Apps menu

AutoSync

  • Introduced multiple sources for one data pipeline

  • Added support for new endpoints: MySQL and SFTP (source), SAP HANA (target)

Platform

  • Added support for New Relic observability tools through OpenTelemetry implementation

  • The JCC now has the additional capability to upload large log files to S3 directly, provided it has the required access.

Snaps

  • Introduced the following Snaps in the Google Analytics 4 Snap Pack:

    • Get Metadata

    • List Accounts

    • List Properties

  • Introduced the PLM TC

SnapGPT

  • Improved support for generating expressions in the Mapper Snap with a new review panel in the UI

  • Added support for answering questions using the SnapLogic documentation knowledge base

Dot Releases - Snaps

Snap Pack

Date of Update

Snap Pack Version

Updates

Snap Pack

Date of Update

Snap Pack Version

Updates

Salesforce

Nov 1, 2023

434patches23646

Fixed an issue where a long-running pipeline containing the Salesforce Subscriber Snap would suddenly stop responding.

Snowflake

Oct 30, 2023

434patches23541

Fixed an issue with the Snowflake-Bulk Load Snap where the Snap wrote irrelevant errors to the error view when both of the following conditions occurred:

  • The inserted data was not in the same order as the table schema.

  • The Staging location was Internal.

Now, the Snap writes the correct errors to the error view.

Active Directory

Oct 27, 2023

434patches23465

Fixed an issue with the Update Entry Snap that caused a null pointer exception when both a delimiter was provided and the attribute value was set to null.

Binary

Oct 27, 2023

434patches23502

Fixed an issue with the File Operation Snap (SFTP protocol) where the error message did not display during a move operation, although the existing file was available in the target path and the Error if exists checkbox was selected.

Oct 27, 2023

434patches23466

Splunk

Oct 20, 2023

434patches23422

The Splunk Basic Auth Account now includes Read timeout and Connection timeout fields, which enable you to manage the timeout settings for your connections.

SAP SuccessFactors

Oct 20, 2023

main150

Fixed an issue with the OAuth 2.0 account that was causing it to reload.

SharePoint Online

Oct 20, 2023

main150

Added pagination in the List Read Items Snap. Also added suggestions for the List name field.

SAP S/4HANA

Oct 20, 2023

main150

Enhanced the input schema for the SAP S/4HANA Create Snap.

SAP Concur

Oct 20, 2023

main150

The SAP Concur Snap Pack now supports v1.0, v1.1, v4.0, and v4.1 API versions. Learn more about the API versions: https://developer.concur.com/api-explorer/

Amazon SQS

Oct 20, 2023

434patches23363

Fixed the behavior change introduced in 4.32 GA related to Amazon SQS Accounts using the STS token. After the 4.32 GA, the account would automatically retry authentication on encountering 401 or 403 errors, and pipelines would not fail even after token expiration. The Amazon SQS Consumer Snap now behaves as expected and fails after the STS token expires.

Binary

Oct 17, 2023

434patches23302

Fixed an issue that occurred when node properties were used to override default algorithm specifications for SFTP operations.

Admin Manager

Features

  • Create a Groundplex configuration and manage Snaplex Versions in the new streamlined interface. All Snaplexes associated with the Environment display on the Snaplexes screen:

     

     

  • Manage login security in Admin Manager by configuring:

    • Session and idle timeouts:

    • Password expiration and notices:

    • Single Sign On (SSO):

Learn more about login security.

Known Issues

  • You cannot delete a group from the Groups screen.
    Workaround: Delete the group from the IIP Manager.

  • When you try to change a user’s role by editing their user account directly, the change is not saved.
    Workaround: Instead of clicking the row for a user to open the edit screen, change their role from the list view.

API Management

Features

  • APIM supports OpenID Connect (OIDC). When you add the Generic OAuth 2 policy to your APIs, you can use an OIDC provider to authenticate the API request, and the Generic OAuth2 policy authorizes it:

     

  • Users with a login for the SnapLogic Platform can now open the Developer Portal with one click from the Resources section of the Apps menu:

Enhancements

  • Response transformation policies for API Proxies (Response Mapper and Response Transformer) now support the API expression language request and response functions, such as request.headers and response. status_code. The dropdown list displays these options when you click in the policy dialog:

     

  • When publishing an API, you can add a link to the Terms of Service and License in the Swagger Editor inside the specification, and both appear as web links in the API details on the Developer Portal:

Fixed Issues

  • There are issues when pushing data multiple times in the API Dashboard from the Snaplex node to the Control Plane.
    Workaround: Reload the dashboard.

AutoSync

AutoSync V1.0 and the accompanying documentation has been deprecated and replaced with the new version of AutoSync. The new version provides an enhanced user experience, improved performance, and is available from the Apps menu. Contact your Customer Success Manager for a free trial of AutoSync. Learn more.

Features

  • AutoSync now supports the following endpoints:

    • SFTP as a source

    • On-premises MySQL as a source

    • SAP HANA as a target (On-premises SAP HANA can only be used in data pipelines with on-premises sources, MySQL, Oracle, or SQL Server.)

  • Now, you can select up to five sources for one data pipeline, with the following exceptions:

    • The CSV file endpoint cannot be used with other sources.

    • On-premises sources (Oracle, SQL Server, and MySQL) can be used in the same data pipeline, but cannot be mixed with off-premises sources.

Example overview of a data pipeline with three sources:

Enhancements

  • You can now select multiple tables to synchronize for Oracle and SQL Server endpoints.

Fixed Issues

  • Integrations with Zendesk as a source and Google BigQuery as a destination now load records correctly for the SCD2 load type.

  • You can now create credentials for on-premises sources in AutoSync.

Known Issues

  • For the SFTP endpoint, Binary Two-factor Auth Accounts created in the IIP can fail with a File not found error.
    Workaround: Create new credentials in AutoSync Manager or edit the Account created in the IIP to include the complete path in the Private Key field instead of a file name.

  • MySQL credentials cannot be created in AutoSync because they need an updated JDBC JAR file.
    Workaround: Create the Account in the IIP and specify the correct JAR file. Learn more.

  • Uploading or updating files in the flyout panel of an existing pipeline with CSV as a source causes an error.
    Workaround: Upload files in the card view.

  • AutoSync uses a UTC timezone to track updates for SCD2 or Incremental load to a Snowflake destination. If you create a Snowflake Account in the IIP, you must add a URI parameter with the name TIMEZONE and set the value to UTC.

  • Users whose emails include a special character other than @ (the at sign) cannot add credentials using the AutoSync Manager in the IIP.
    Workaround:

    • To share an Account with all users in the environment, create them in the IIP, from the Manager Accounts tab, and save them in the global shared folder.

    • To share with AutoSync users, create credentials in AutoSync and share them with an individual or a group.

Platform

The Dashboard Lineage tab will be discontinued in the November 2023 release.

Features

  • SnapLogic’s third-party Observability tools integration now extends to New Relic observability tools. You can now monitor and analyze your runtime logs in New Relic software.

Enhancements

  • The Activity Log has more details about Org admin actions made to Manager > Settings. For example, when an Org admin changes the values for a Session Timeout, the Activity Log records the event change:

Snaps

The Snaps mentioned in this section are deployed on the Latest distribution type. To access the updated Snap Packs, an Org admin must select the Snap Pack version in Manager > Snap Packs.

Behavior Change

Upcoming

New Snaps

  • Introduced the following Snaps in the Google Analytics 4 Snap Pack:

    • Get Metadata: Fetches all the metrics and dimensions associated with your Google service account ID and property ID

    • List Accounts: Fetches all the account IDs associated with your Google service account

    • List Properties: Fetches all the property IDs associated with your account ID

  • Introduced the PLM TC Snap Pack, which includes the following comprehensive list of Snaps:

Enhancements

  • The Binary Upload File Snap now supports files larger than 2 GB.

  • The Copybook Parser Snap now supports configuring fields from subsequent copybooks using fully qualified names.

  • The Cross company checkbox is added to the Microsoft Dynamics 365 Finance and SCM Create, Update, and Delete Snaps to ensure the other company (other than the default company) records are created, updated, and deleted.

  • The JDBC driver for the Oracle Snap Pack is upgraded from OJDBC6 JAR (v11.2.0.4) to OJDBC10 JAR (v19.20.0.0) in the latest distribution in October 2023 (434patches23000) and in the stable distribution in the November 2023 release (after the Snaplex upgrade). This upgrade changes specific error codes and status messages. The latest JDBC driver upgrade is backward-compatible. Learn more: Upgrading from Oracle JDBC 11.2.0.4 Driver to 19.20.0.0 Driver.

  • Enhanced the Parquet Writer Snap with a Decimal Rounding Mode dropdown list to enable the rounding method for decimal values when the number exceeds the required decimal places.

  • The SAP Concur OAuth2 Account now supports the Auth endpoint config and Token endpoint config field sets to configure custom properties for the OAuth2 endpoint.

Fixed Issues

Known Issues

  • The Microsoft Dynamics 365 Finance and SCM Create, Update, and Delete Snaps encounter the following errors intermittently when you run a batch process on the same entity in a pipeline.

    • 500 (Internal Server Error)

    • Socket timeout error

    • Read timeout error

    Workaround: Increase the Timeout value to 500 (or higher) and decrease the Batch size with the default retry properties.

Custom Snaps

Introduced the Databricks Utils Snap Pack, to perform powerful combinations of tasks. You can use the utilities to work with object storage efficiently, to chain and parameterize notebooks, and to work with secrets. This Snap Pack includes the following Snaps and an account:

SnapGPT

  • Improved support for generating expressions in the Mapper Snap with a new review panel in the UI

  • Added support for answering questions using the SnapLogic documentation knowledge base

Documentation Enhancements