December 2023 Release Notes

 

Highlights

The SnapLogic® December 2023 Release includes the following:

Admin Manager

  • Manage Allowlists for Cloudplex and CORS with an easy-to-use interface

API Management

  • Outbound OAuth2 Policy for Proxies

AutoSync

  • On-premises endpoints: PostgreSQL as a source and MySQL as a target

  • Replace empty values (null handling) transformation

Platform

  • Additional Org changes are reported in the Activity log

  • Task failure notifications for Not Started state

  • Support for untracking Assets from Git

Snaps

  • Introduced the PDF Snap Pack

SnapGPT

  • Supports generation of a SnapLogic expression from natural language

  • SnapGPT is now available in the EMEA region (Europe-Middle East-Africa)

Dot Releases - Platform

Snaplex Version

Date of Update

Feature

Updates

Snaplex Version

Date of Update

Feature

Updates

main-21799 - 4.35 Patch 3 (Recommended)

Dec 19, 2023

Ultra Tasks

  • Fixed a Snaplex connection issue when upgrading to 4.35 where some Ultra Tasks displayed a No Active Feed Masters found error message in the Task details page, despite FeedMaster nodes being deployed.

  • Fixed an issue where disk space was being consumed by bouncy castle exceptions in the JCC logs.

main-21624 - 4.35 Patch 2

Dec 15, 2023

Platform

  • Fixed an authorization issue with runtimes.

  • Fixed an issue where Expression Enabled fields responded slowly to user input.

Dashboard

Fixed reporting issues with Dashboard metrics.

Scheduled Tasks

Added Hours as a scheduling interval to the Scheduled Task dialog.
Fixed issues with the Task notification feature.

Dot Releases - Snaps

Snap Pack

Date of Update

Snap Pack Version

Updates

Snap Pack

Date of Update

Snap Pack Version

Updates

ELT

Jan 11, 2024

435patches24461

Fixed an issue with the ELT Merge Into Snap that caused malformed aliases and table identifiers in its generated SQL statement.

Transform

Jan 10, 2024

435patches24481

Fixed an issue with the Aggregate Snap where the Snap was unable to produce the desired number of output documents when the input was unsorted and the GROUP-BY fields field set was used.

Copybook

Jan 10, 2024

main165

The Compatibility field is now set to false by default in the Copybook Parser Snap and it does not display in the UI for new instances of the Snap.

Copybook

Jan 3, 2024

main163

Fixed backward compatibility for Snap instances with missing debug configuration.

Salesforce

Dec 22, 2023

435patches24368

Enhanced the performance of the Salesforce Bulk Query Snap with a new Maximum threads field. This field enables you to download query results simultaneously in multiple threads.

Marketo

Dec 21, 2023

435patches24332

Enhanced the Marketo Asset Read Snap to enable pagination when the maxReturn input query parameter value exceeds 200. We recommend that you set the maxReturn value to 0 or a large integer to fetch all the records.

Microsoft Dynamics 365 Finance and SCM

Dec 21, 2023

435patches24298

Added the following Snaps in the Microsoft Dynamics 365 Finance and SCM Snap Pack:

Amazon S3

Dec 21, 2023

435patches24238

Added support for Amazon S3 Express One Zone in the Amazon S3 Snap Pack.

NetSuite REST

Dec 20, 2023

435patches24337

Marketo

Dec 19, 2023

435patches24248

  • Enhanced the Marketo Bulk Extract Snap with the Include export ID checkbox. When you select this option, the Snap displays the export ID in the output.

  • Added support to Marketo Bulk Lead Extract to display the Export ID in the output.

Workday

Dec 19, 2023

435patches24309

Added the WorkdayQL Snap, which connects with the Workday Query Language (WQL) endpoints.

HubSpot

Dec 15, 2023

main160

Improved error reporting in HubSpot Snaps.

Tableau

Dec 15, 2023

435patches24275

Updated the documentation URLs and the UI labels for the Snaps in the Tableau Snap Pack. Refer to the Tableau Snap Pack for the latest and current documentation.

SumoLogic

Dec 15, 2023

435patches24274

Updated the documentation URLs and the UI labels for the Snaps in the SumoLogic Snap Pack. Refer to the SumoLogic Snap Pack for the latest and current documentation.

Google Analytics

Dec 15, 2023

435patches24127

Updated the documentation URLs and the UI labels for the Snaps in the Google Analytics Snap Pack. Refer to the Google Analytics Snap Pack for the latest and current documentation.

Birst

Dec 15, 2023

435patches24296

Updated the documentation URLs and the UI labels for the Snaps in the Birst Snap Pack. Refer to the Birst Snap Pack for the latest and current documentation.

Anaplan

Dec 15, 2023

435patches24274

Updated the documentation URLs and the UI labels for the Snaps in the Anaplan Snap Pack. Refer to the Anaplan Snap Pack for the latest and current documentation.

Snowflake

Dec 14, 2023

435patches24110

Added a lint warning to the Snowflake-Bulk Load Snap that recommends users to select the Purge checkbox when the Data source is input view and the Staging location is External.

Admin Manager

Features

Introduced a user-friendly interface, to manage Allowlists for Cloudplex and CORS.

 

API Management

Features

The Outbound OAuth2 Policy allows users to connect Proxies to backend APIs and systems that use OAuth2 for authentication with preconfigured OAuth2 Accounts. You can access these preconfigured accounts from the Account Tab.

Enhancements

  • Group and classify the APIs as per the category and filter selection to include enhanced features that help in easy navigation of the APIs:

    • View the selected API category in the search bar after you browse the API documentation.

    • The API Catalog page subtitle shows the count and selected category.

    • To easily navigate specific APIs, this enhancement now only allows selection of a single category with multiple filters.

Fixed Issues

  • Fixed an issue with the JWT Validator policy where token expiration was not checked.

  • Fixed an issue with the Generic OAuth2 Policy that would cause request errors when the API was called by a browser in incognito mode.

  • Fixed an issue where the Developer Portal Welcome email body did not contain reset password links.

  • Fixed an issue where the Swagger Editor accessed from the publish dialog displays the incorrect specification file when you choose a different one.

  • Fixed an issue where the Alerts/Activity Notifications did not track versions created from APIs.

Behavior Changes

When you create an API from a Project, assets now appear in the API Version gradually (instead of by bulk update) because of a change made to the migrate API to support file and asset movement asynchronously. This improves the copy operation when there are a large number of assets involved.

Known Issues

When creating an API from a Project and you select individual assets, the API Verison is not populated with the assets.
Workaround: Select the parent asset category from the picker. Then, once the API version is created and populated with all of the assets from the Project, you can delete the individual assets from the API version that should not be included.

AutoSync

Features

  • New on-premises endpoints: PostgreSQL as a source and MySQL as a target.

  • Transform your data before loading to the destination by handling null values. The wizard now includes a Replace empty values screen:

    Select the suggested value based on the data type, or enter a custom value. For example, the suggested value for a string field is an empty string:

    Learn more about null handling with this feature.

Enhancements

For all endpoints except MySQL, if the destination supports it, AutoSync now stores timestamp values with up to nanosecond precision.

Fixed Issues and Behavior Changes

The December 2023 release fixes the following issues and introduces some changes to behavior. Fixes and changes to the underlying implementation do not automatically propagate to existing integrations. Check the endpoints mentioned in this section to determine whether you need to refresh any integrations. If yes, edit the data pipeline and save it. The simplest edit is to make a minor name change. Any edit that requires a save updates the data pipeline to the latest behavior.

  • For the Salesforce endpoint, AutoSync cannot synchronize objects that do not support the bulk load API. Previously, these objects were available to select but caused synchronization to fail. Now, objects that are not eligible for synchronization are not in the table selection dropdown. Refer to Salesforce documentation for a list of objects that do not support bulk load.

  • Data pipelines with Oracle as the source and Snowflake as the destination now correctly report the number of updated records when using Incremental load.

  • Data pipelines with an Amazon Redshift destination using the SCD2 load type now store timestamps up to nanoseconds. Historical records stored before the December 2023 release have a timestamp limited to 3 fractional second digits. (Historical records are those with a value of N (to indicate No) in the destination table autosync_currentrecordflag column.) Records updated after the December 2023 release store timestamps up to nanoseconds.

  • For integrations with Google BigQuery as a source or destination, the Filter columns data preview now contains data.

  • For integrations with MySQL as a destination, if the source does not define precision for a column that AutoSync maps to a varchar type, AutoSync now creates columns with precision of 255 to avoid MySQL’s row size limit.

  • AutoSync does not support some Account types created in the IIP. Previously, you could select a non-supported Account type, such as Salesforce OAuth, in AutoSync to edit. Now, the AutoSync Edit/Remove Credentials screen only lets you edit supported types.

  • For integrations that load from Google BigQuery to Google BigQuery, failures can occur if a source BIGNUMERIC column does not have precision and scale set and contains a. value with precision larger than 76. This happens because when the precision and scale for a BIGNUMERIC column are not set in the source, AutoSync sets it to (76, 38) when creating the target table. BigQuery can actually store a BIGNUMERIC value with a precision and scale of (76.76, 38).

  • For Google Analytics 4, you can now upload or select an existing JSON key file.

Known Issues

  • The data pipeline wizard Replace empty values screen incorrectly shows non-nullable columns. If you specify a replacement value for a non-nullable column, AutoSync ignores it, which is the correct behavior.

  • For integrations loading to MySQL, if the source does not define precision for columns that AutoSync maps to a varchar type and values in the source have greater precision and scale than 255, the integration fails. AutoSync sets the precision to 255 to keep under MySQL’s row size limit.
    Workaround: If a failure occurs, you can change the precision and scale in the source to be compatible with MySQL’s default precision and scale.

Monitor

Fixed issues

  • The Metrics screen now displays the correct values for memory utilization:

    • Total CPU utilization: The percentage of use for the machine’s CPU.

    • CPU utilization by JVM: The percentage of use for the machine’s CPU by the Snaplex node’s JVM.

    • Memory utilization: The percentage of use of the maximum JVM heap size (not the machine’s physical memory).

Platform

Enhancements

  • Changes made to your Git-tracked Assets are automatically indicated with Local modified status in the project asset table. This enables you to view the Projects that are updated in Git without clicking Git status.

  • Added the new task status - Not Started to allow configuring alert notifications to a customizable list of users when a Scheduled Task does not start.

  • Enhanced the Task scheduling capability to enable scheduling a task to run for every n number of hours, in addition to the existing yearly, monthly, and daily run scheduling options.

  • You can now stop tracking SnapLogic Projects with Git via Public APIs.

Known Issues

  • Snaplex memory utilization numbers in the IIP dashboard are inconsistent.
    Workaround: Refer to Monitor Metrics for the correct values.

  • When scheduling a task to execute across different locales, the pipeline might not execute because non-ASCII characters in the date configuration result in an invalid signature.
    Workaround: If your Snaplexes use different language settings through a global property in the Snaplex, we recommend you set it to Duser.language.format=en -Duser.country.format=EN for the most reliable adherence to the schedule set in the task.

  • When retrieving account details, if the SnapLogic Account is not in the same project as the pipeline, the SnapLogic Read Snap might incorrectly retrieve details of an account with the same name from a different project, even when you specify the absolute project path.

Fixed Issues

  • Fixed an issue where the alerts debug log level displayed secrets in plain text.

  • Fixed an issue where the expression toggle did not display with imported expression libraries.

Behavior Changes

The APIM Migrate Proxy Public API now requires the new dest_proxy_name parameter in the request body if migrating into the same Environment/Org.

Snaps

The Snaps mentioned in this section are deployed on the Latest distribution type. To access the updated Snap Packs, an Org admin must select the Snap Pack version in Manager > Snap Packs.

New Snaps

  • Introduced the PDF Snap Pack, which contains the following Snaps:

    • PDF Formatter: Enables you to format an input document as an output PDF document

    • PDF Lock: Password-protects a PDF document to prevent unauthorized access to the PDF file

    • PDF Merger: Merges multiple PDF documents into a single PDF document

    • PDF Parser: Extracts text, images, or tables from a PDF document from any upstream binary source

    • PDF Splitter: Splits a single PDF document into multiple PDF documents

    • PDF Unlock: Removes password protection from PDF files

This PDF Snap Pack is available on both the stable and latest distributions (435patches24256).

Enhancements

Known Issues

  • PDF Formatter Snap: Some special Unicode characters or symbols might not be parsed correctly

  • PDF Splitter Snap: Some pages in the output might be blank for PDFs that are not parsed correctly

  • The PDF Merger and Splitter Snaps do not work in Ultra Pipelines

  • The PDF Parser Snap might encounter issues when it parses tables that are embedded images, lack borders, have a complex row-column structure, or span across multiple pages.

SnapGPT

  • Supports generating a SnapLogic expression from natural language when you configure a Snap

  • SnapGPT is now available in the EMEA region (Europe-Middle East-Africa)

Documentation Enhancements

Enhancements

  • Introduced the Patterns Catalog document: The Patterns Catalog in SnapLogic Designer enables you to create your own patterns within your project space from the Patterns tab in the Designer.

  • Enhanced the Error handling document with examples and use case scenarios.

  • Reorganized the workflow and procedures in the Cache Pipeline document and restructured the Pipeline Cache Properties to enhance accessibility, ensuring easy comprehension for users.

  • Improved the Pipeline Queuing documentation by addressing the gaps in information and aligning the content with the latest user interface.