[ Highlights ] [ Dot Releases - Snaps ] [ Admin Manager ] [ API Management ] [ AutoSync ] [ Platform ] [ Snaps ] [ SnapGPT ] [ Documentation Enhancements ]

Highlights

The SnapLogic®^{September 2023 Release includes the following:}

Admin Manager

• Manage Snap Pack versions

...

• New API Policy HTTP Redirect enables you to define behavior for HTTP 3xx status codes

• Enhanced sidebar menu for viewing and editing Applications on the Developer Portal

AutoSync

• New source endpoints: Azure Synapse, Redshift, and Zendesk

• Azure Synapse endpoint supports schema change detection and reconciliation

...

• The JSON key field in the Binary Google Service Account supports JSON strings. You can upload the JSON key either from SLDB or dynamically pass the value using a pipeline parameter or access values from Secrets Manager

SnapGPT

• Added support for expression generation for the Mapper Snap

• Added support for SQL and SOQL query generation

Documentation Enhancements

• Public APIs and Admin Manager on the new documentation portal

• Automate business operations with Microsoft Dynamics 365 Business Central Snap Pack

Dot Releases - Snaps

Admin Manager

As Manager administrative pages become available in Admin Manager, the old pages will be phased out. After approximately one month, the links in Manager will redirect to the new screens in Admin Manager.

The August release of Admin Manager provided a new interface for Environment admins to manage users and groups. This release adds Snap Pack management. From the October release onwards, the following Manager pages will redirect to Admin Manager:

• Users

• Groups

• Snap Packs

Learn more about Admin Manager.

Features

Management for Snap Packs is now available in Admin Manager. Similar to the capability in Classic Manager, Environment admins can:

• Set the default Snap Pack version to use when running Intelligent Integration Platform (IIP) pipelines.

• Override the version for specific Snap Packs.

• Select the New or Old distribution:

  • Current Snaplex versions align with Snaps support Snap Packs from the New distribution.

  • Earlier Snaplex versions align with Snaps support Snap Packs from the Old distribution.

...

Click a Snap Pack to view the available Snaps:

...

• AutoSync now supports the following endpoints:

  • Azure Synapse Amazon Redshift as a sourceRedshift

  • Azure Synapse as a source

  • Zendesk as a source

Enhancements

• The Azure Synapse endpoint supports schema change detection and reconciliation. Learn more.

• In Orgs with a large number of Accounts and credentials, credentials now load faster in the data pipeline wizard.

• Error reporting tables in Snowflake are now created as transient tables to reduce storage costs.

• Users with view permissions can now mark data pipelines as favorites.

...

• Users must add credentials for Gainsight PX and Zendesk in AutosyncAutoSync, not in the IIP or AutoSync Manager.

• Integrations with Zendesk as a source and Google BigQuery as a destination may fail to load records when using the SCD2 load type.

• Data pipelines with Oracle as the source and Snowflake as the destination incorrectly report the number of can miss new and updated records when using the Incremental load type. For example, when a record is added, the details show that it was added and updated. The issue occurs because Oracle has the capability to store timestamps with precision down to a nanosecond (by default it is microsecond), but AutoSync timestamps are limited to millisecond precision. Incremental loads depend on the timestamp, and if a record update occurs only nanoseconds after the previous update, AutoSync does not recognize it as an updateThis is due to a difference in precision between Oracle and AutoSync timestamps.

Platform

...

However, the task with the associated Snaplexes that are both labeled mainplex in each Org, with runtime_path_ids of /dev/rt/cloud/testtask and /prod/rt/cloud/testtask, does not work.

Snaps

...

...

• Enhanced the Anaplan Snap Pack with support for retries to avoid Server failure error during the pipeline execution.

• The JSON key field in the Binary Google Service Account supports JSON strings. You can upload the JSON key either from SLDB or dynamically pass the value using a pipeline parameter or access values from Secrets Manager.

• Hadoop Snap Pack:

  • Enhanced the Parquet Writer /wiki/spaces/SD/pages/1438227 Snap with the support for LocalDate and DateTime. The Snap now shows the schema suggestions for LocalDate and DateTime correctly.

  • Enhanced the Parquet Reader Snap with the Use datetime types checkboxthat supports LocalDate and DateTime datatypes.

• Added proxy authentication for the Microsoft Dynamics 365 Finance and SCM and Microsoft Dynamics 365 Business Central Snap Packs.

• The Instance URL field in the Microsoft Dynamics 365 Finance and SCM Access Token Account and the Business Central Access Token Account is no longer expression enabled by default.

• Improved the Salesforce Bulk Upsert Snap error messages by limiting the length of the reason displayed with the error. (Within the error reported to the UI, the full message is logged.)

• Improved the SQL Server Bulk Load Snap to reduce the chance of causing a deadlock error.

...

• Fixed an issue with the Anaplan Action Snap that caused the File Not Found error to display when multiple instances of the Anaplan Upload Snap (which included empty files) were executed concurrently.

• Fixed an issue with the Azure Active Directory Create Entry Snap that caused it to fail with a cast error when a boolean value was entered in a field where expressions were enabled.

• Fixed an issue with the Google Analytics 4 Create Report and the Create Realtime Report Snaps that improperly rounded off decimal data. You can now view the precise value in the report.

• Fixed an issue with the HTTP Client Snap that displayed incorrect cookie information, with a null value in the cookies when you have duplicate cookies in the header. The Snap now displays the cookie information correctly.

• Fixed an issue with the JSON Splitter Snap that caused the pipeline to terminate with excessive memory usage on the Snaplex node after the 4.33 GA upgrade. The Snap now consumes less memory.

• Fixed an issue with the Microsoft OneDrive Snap Pack where the Snaps displayed Duplicate key OneDrive error. The Snaps now hide the drive details stored in the PreservationHoldLibrary folder when displaying suggestions. You can use the Drive ID to search for items in the PreservationHoldLibrary folder.

• Fixed an issue with the Oracle Bulk Load Snap that was not resilient to the errors previously when trying to auto-discover the existing SQLLDR utility paths in the node. The Snap is now robust to those errors.

• Fixed an issue with the Pipeline Execute Snap that caused a null pointer exception during the retry when the input view was a Binary type. Retry is not supported for a Binary input view with this Snap.

• Fixed an issue with the SOAP Execute Snap that caused it to be unable to parse some WSDL files.

• Fixed an issue with the SQL Server Stored Procedure and Table List Snaps that caused no retries to be executed even though the user had selected a number of retries in the UI when a custom JDBC driver was used.

• Updated the input and output schema for the Marketo Snaps.

Behavior Changes

• When you select the Use datetime types checkbox in the Parquet Reader Snap, the Snap displays the LocalDate and DateTime in the output for INT32 (DATE) and INT64 (TIMESTAMP_MILLIS) columns. When you deselect this checkbox, the columns retain the previous datatypes and display string and integer values in the output.

...

• When processing data, the Oracle Bulk Load Snap executes in an infinite loop when database storage reaches full capacity.

• The Microsoft Dynamics 365 Business Central Create, Update, and Delete Snaps display the following errors when you run the batch process with the error view enabled.

  • 500 ( Internal Server Error)

  • Socket timeout error

  • Read timed out error

  Workaround: Increase the Timeout value to 500 or more and decrease the batch size , along with while keeping the default retry properties.

...