[ Highlights ] [ Admin Manager ] [ API Management ] [ AutoSync ] [ Platform ] [ Snaps ] [ SnapGPT ] [ Documentation Enhancements ]
Highlights
Manage Snap Pack versions
New API Policy HTTP Redirect enables you to define behavior for HTTP 3xx status codes
Enhanced sidebar menu for viewing and editing Applications on Developer Portal
New source endpoints: Azure Synapse, Redshift, and Zendesk
Azure Synapse endpoint supports schema change detection and reconciliation
Activity Log now tracks changes to Org Settings
The JSON key field in the Binary Google Service Account supports JSON strings. You can upload the JSON key either from SLDB or dynamically pass the value using a pipeline parameter or access values from Secrets Manager
Added support for expression generation for the Mapper Snap
Added support for SQL and SOQL query generation
Admin Manager
As Manager administrative pages become available in Admin Manager, the old pages will be phased out. After approximately one month, the links in Manager will redirect to the new screens in Admin Manager.
The August release of Admin Manager provided a new interface for Environment admins to manage users and groups. This release adds Snap Pack management. From the October release onwards, the following Manager pages will redirect to Admin Manager:
Users
Groups
Snap Packs
Features
Management for Snap Packs is now available in Admin Manager. Similar to the capability in Classic Manager, Environment admins can:
Set the default Snap Pack version to use when running Intelligent Integration Platform (IIP) pipelines.
Override the version for specific Snap Packs.
Select the New or Old distribution:
Current Snaplex versions align with Snaps from the New distribution.
Earlier Snaplex versions align with Snaps from the Old distribution.
Click a Snap Pack to view the available Snaps:
API Management
Features
HTTP Redirect Policy: This new policy enables you to define the behavior of 3xx errors for your APIs. When you apply the policy, the client is sent an HTTP redirect message. For example, you can send an HTTP redirect to force a client to enter user credentials on an HTML login page if an HTTP cookie doesn’t already exist. Another use case is that you can send an HTTP redirect if a web page has moved to a new URL address.
This feature is available only on the 4.34 Patch 1 Snaplex version.
Enhancements
The Callout Authenticator API policy now supports additional HTTP methods POST, PUT, and PATCH.
The Developer Portal supports referencing external API documentation when publishing. When you publish an API, you can open the specification editor and add the fields that reference external documentation for the API.
externalDoc: Description: url:
When you view the API in the Developer Portal, the link appears under the specification type:
Application information is now displayed in a sidebar. Included are Details and Subscription tabs.
AutoSync
Features
AutoSync now supports the following endpoints:
Enhancements
The Azure Synapse endpoint supports schema change detection and reconciliation. Learn more.
In Orgs with a large number of Accounts and credentials, credentials now load faster in the data pipeline wizard.
Error reporting tables in Snowflake are now created as transient tables to reduce storage costs.
Users with view permissions can now mark data pipelines as favorites.
Fixed Issues
When a data pipeline with Snowflake as a destination encounters an error, it now logs the error record and continues.
Known Issues
Users must add credentials for Gainsight PX and Zendesk in Autosync, not in the IIP or AutoSync Manager.
Integrations with Zendesk as a source and Google BigQuery as a destination may fail to load records when using the SCD2 load type.
Data pipelines with Oracle as the source and Snowflake as the destination incorrectly report the number of updated records when using the Incremental load type. For example, when a record is added, the details show that it was added and updated. The issue occurs because Oracle has the capability to store timestamps with precision down to a nanosecond (by default it is microsecond), but AutoSync timestamps are limited to millisecond precision. Incremental loads depend on the timestamp, and if a record update occurs only nanoseconds after the previous update, AutoSync does not recognize it as an update.
Platform
EMEA Control Plane
A new control plane is available in the EMEA region (Europe-Middle East-Africa) available for new customers. The EMEA Control Plane is located in AWS eu-west-1 (Ireland) and is live as of September 12. All provisioning, Cloudplex nodes, and licensing agreements are similar to those of the current control plane. Refer to Adding the SnapLogic Platform to your Allowlist for new IP addresses and Groundplex Network Setup for Groundplex configuration updates. Contact your CSM for more details.
We have revised the Adding the SnapLogic Platform to your Allowlist document to include IP addresses for outbound requests from different third-party partners such as GitHub.com, GitLab Cloud, Azure Repos, and Slack.
Features
The new APIM Public API Migrate a proxy is available.
Enhancements
The APIM Public API Export APIM policies accepts the query parameter
policies_to_export
, instead ofpolicies_to_include
.The Public API Retrieve config info for a Groundplex accepts the query parameter
version
. If set tocurrent
, the returned configuration is based on the version currently installed on the Snaplex, instead of the latest available version.The Activity Log tracks changes made to Org Settings in Manager. Your organization can now audit changes made to your SnapLogic Org by referring to the events in the Activity Log.
Scheduled Tasks improved with new misfire thresholds. This new mechanism offers granularity in tasks that run in intervals of less than 15, 10, 5 minutes, and even 1 minute.
The Scheduled Task dialog now displays an error when you enter an invalid number of task runs. When you select After # of Runs and enter a number above the maximum value supported by the field or a negative number, an error prompts you to enter a valid number range of 1 - 1,000,000. Previously, the dialog would allow you to save the Scheduled Task with the invalid number and then subsequently fail. Only upon viewing the Task Details page, would you discover the task failure resulting from the invalid field value.
Fixed Issues
Fixed an issue where the RunTime Archive did not display content.
Fixed an issue where the API response for Snaplex Configuration REST API gave the incorrect Snaplex version to download.
Fixed an issue where Orgs with Enhanced Encryption did not work properly with the Secrets Management feature enabled.
Behavior Changes
Org admins can no longer enter URLs into User Notifications. Before this release, if an Org admin entered text that resembled a URL, the UI would turn it into a clickable link in the notification display viewed by the user. This is no longer possible. Users have to copy and paste any valid links shared by an Org admin into a browser to access the target site.
Best Practice on Asset Migration at the Org-level
When a task is migrated to another Org, the Snaplex references are fixed by the runtime_path_id
property and not by the Snaplex name. Accordingly, you should make sure that the values for the Location and Environment fields in the Snaplex dialogs match - not the labels, as one might assume.
For example:
When migrating the task testtask from the dev to prod Orgs, a task from the dev Org with the runtime_path_id
of /dev/rt/cloud/testtask
is replaced with the runtime_path_id
of /prod/rt/cloud/testtask
, even if the two Snaplexes have different labels, such as devplex and prodplex.
However, the task with the associated Snaplexes that are both labeled mainplex in each Org, with runtime_path_ids
of /dev/rt/cloud/testtask
and /prod/rt/cloud/testtask
does not work.
Snaps
The Snaps mentioned in this section are deployed on the Latest distribution type. To access the updated Snap Packs, an Org admin must select the Snap Pack version in Manager > Snap Packs.
Upcoming
We plan to upgrade the Oracle Snap Pack to use the latest 19c JDBC JAR file (19.19.0.0 as of November 8, 2023).
Pipelines that use the default JDBC driver in the Oracle server accounts might be impacted after the driver upgrade because the latest driver is backward-incompatible. We will soon communicate how to reconfigure to prevent accounts from being impacted.
Pipelines that do not use the default driver (bundled with the Oracle Snap Pack) are not impacted.
Enhancements
Enhanced the Anaplan Snap Pack with support for retries to avoid
Server failure
error during the pipeline execution.The JSON key field in the Binary Google Service Account supports JSON strings. You can upload the JSON key from SLDB or dynamically pass the value using a pipeline parameter or access values from Secrets Manager.
Hadoop Snap Pack:
Enhanced the Parquet Writer Snap with the support for LocalDate and DateTime. The Snap now shows the schema suggestions for LocalDate and DateTime correctly.
Enhanced the Parquet Reader Snap with the Use datetime types checkbox that supports LocalDate and DateTime datatypes.
Added proxy authentication for the Microsoft Dynamics 365 Finance and SCM and Microsoft Dynamics 365 Business Central Snap Packs.
The Instance URL field in the Microsoft Dynamics 365 Finance and SCM Access Token Account and the Business Central Access Token Account is no longer expression enabled by default.
Improved the Salesforce Bulk Upsert Snap error messages by limiting the length of the reason displayed with the error. (Within the error reported to the UI, the full message is logged.)
Improved the SQL Server Bulk Load Snap to reduce the chance of causing a deadlock error.
Fixed Issues
Fixed an issue with the Anaplan Action Snap that caused the
File Not Found
error to display when multiple instances of the Anaplan Upload Snap (which included empty files) were executed concurrently.Fixed an issue with the Azure Active Directory Create Entry Snap that caused it to fail with a cast error when a boolean value was entered in a field where expressions were enabled.
Fixed an issue with the Google Analytics 4 Create Report and the Create Realtime Report Snaps that improperly rounded off decimal data. You can now view the precise value in the report.
Fixed an issue with the HTTP Client Snap that displayed incorrect cookie information, with a null value in the cookies when you have duplicate cookies in the header. The Snap now displays the cookie information correctly.
Fixed an issue with the JSON Splitter Snap that caused the pipeline to terminate with excessive memory usage on the Snaplex node after the
4.33 GA
upgrade. The Snap now consumes less memory.Fixed an issue with the Microsoft OneDrive Snap Pack where the Snaps displayed
Duplicate key OneDrive
error. The Snaps now hide the drive details stored in thePreservationHoldLibrary
folder when displaying suggestions. You can use the Drive ID to search for items in thePreservationHoldLibrary
folder.Fixed an issue with the Oracle Bulk Load Snap that was not resilient to the errors previously when trying to auto-discover the existing SQLLDR utility paths in the node. The Snap is now robust to those errors.
Fixed an issue with the Pipeline Execute Snap that caused a null pointer exception during the retry when the input view was a Binary type. Retry is not supported for a Binary input view with this Snap.
Fixed an issue with the SOAP Execute Snap that caused it to be unable to parse some WSDL files.
Fixed an issue with the SQL Server Stored Procedure and Table List Snaps that caused no retries to be executed even though the user had selected a number of retries in the UI when a custom JDBC driver was used.
Updated the input and output schema for the Marketo Snaps.
Behavior Changes
When you select the Use datetime types checkbox in the Parquet Reader Snap, the Snap displays the LocalDate and DateTime in the output for INT32 (DATE) and INT64 (TIMESTAMP_MILLIS) columns. When you deselect this checkbox, the columns retain the previous datatypes and display string and integer values in the output.
Known Issues
When processing data, the Oracle Bulk Load Snap executes in an infinite loop when database storage reaches full capacity.
The Microsoft Dynamics 365 Business Central Create, Update, and Delete Snaps display the following errors when you run the batch process with the error view enabled.
500 ( Internal Server Error)
Socket timeout error
Read timed out error
Workaround: Increase the Timeout value to 500 or more and decrease the batch size while keeping the default retry properties.
Custom Snaps
Enhanced the following Custom Snap Pack documents for better clarity and the latest UI.
SnapGPT
Documentation Enhancements
Starting with this release, the following documentation is available only in the new documentation portal:
Monitor (formerly Studio)
New Articles
Learn how to automate Finance, Accounting, Procurement, and CRM Functions using the Microsoft Dynamics 365 Business Central Use Case.