Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
minLevel1
maxLevel1
outlinefalse
typeflat
printablefalse

Highlights

The SnapLogic®July 2023 Release includes the following:

...

🆕 SnapGPT (Early Access)

You can now build your pipelines using simple text prompts.

Snap Updates in July

API Management

  • Generate specifications for your API Proxy

  • New Response policies for your API Proxy

  • Support for Git Integration

...

  • Renamed to Monitor to better reflect its functionality

Dot Releases - Snaps

24 Jul

Snap Pack

Date of Update

Snap Pack Version

Updates

GraphQL Client

Transform

433patches22065

433patches22431

  • Fixed an issue with the

GraphQL Client
an error even when the variable value was defined in the previous Snap.
  • it to produce binary output data when there was no input document and Ignore empty stream was selected.

  • Introduced the following new Snaps:

    • GeoJSON Parser: Parses geospatial data from binary data input and outputs the contents as a GeoJSON document downstream.

    • WKT Parser: Parses geospatial data from binary data input and outputs the contents as a WKT (Well Known Text) document downstream.

Microsoft Dynamics 365 Business Central

433patches22215

Introduced the Microsoft Dynamics 365 Business Central Snap Pack. This Snap Pack comprises the following Snaps and Accounts:

Google BigQuery

433patches22057

Introduced the Google BigQuery Upsert (Streaming)Snap, which enables you to perform bulk update/insert operations into a BigQuery table from existing tables or any input data stream.

Anaplan

433patches22443

  • The Anaplan Action Snap now supports Data errors/warnings for better output handling and also fixed empty reason for process failure.

  • All the Anaplan Snaps now display the status code as part of the error message if the error status code is available as part of Anaplan API response.

Exchange Online

433patches22402

Fixed an issue with the Send Email Snap where attachments larger than 3 MB were not getting attached to the sent email messages.

SAP

433patches22386

Fixed an issue with the SnapLogic SAP Accounts that caused issues when connection pools were exhausted. The minimum value allowed for the Connection pool capacity is now 0 so you can disable the connection pooling.

Flow

433patches22107

Fixed an issue with the Pipeline Execute Snap that caused it to acknowledge the Ultra pipeline message before the message reached the last Snap in the pipeline. Because of the early acknowledgment, the last Snap in the pipeline failed and the response could not be sent back.

Hadoop

433patches22180

Introduced a Hadoop Snap, HDFS Delete, which deletes the specified file, group of files, or directory from the supplied path and protocol in the Hadoop Distributed File System (HDFS).

SQL Server

433patches22090

The SQL Server Stored Procedure and SQL Server Table List Snaps now support the retry functionality.

Vertica

433patches22343

Fixed an issue with the Vertica-Bulk Load Snap that previously displayed an empty output when no input was provided.

Behavior Change: If the Snap receives no input, no output is sent to the output view.

Azure Service Bus

433patches22297

Fixed the asynchronous message processing issue in the ASB Consumer Snap by enabling the upper range of value for the Prefetch Count field to five. When the value exceeds five, the Snap displays a lint warning in the pipeline execution statistics.

Binary

433patches22297

  • Fixed an issue with the PGP Sign Snap that caused an error when using an encryption subkey for signing.

  • Fixed an issue with the File Writer Snap where the file was unable to validate when the File action field was set to IGNORE for the WASB and WASBs protocols.

Google Directory

433patches22103

Fixed an issue with the Google Directory Update Snap where it could not add or update organizations and displayed the error IO error occurred. The Snap now works as expected, allowing you to update the organization and IMS details successfully.

GraphQL Client

433patches22065

Fixed an issue with the GraphQL Client Snap that caused an error even when the variable value was defined in the previous Snap.

Google BigQuery

433patches21955

Fixed an issue with the GBQ-Google Service Account that caused an input stream to remain open.

Anaplan

433patches22009

  • Fixed an issue with the Anaplan Upload Snap where the Snap displayed an error when attempting to upload different files using multiple Anaplan Upload Snaps in parallel. The Snap now works as expected and successfully uploads the files with different filenames.

  • Fixed

an issue with
that caused the Snap to fail intermittently with Certificate Authentication Failed error, by implementing the retry mechanism.
  • by implementing the retry feature:

    • Connection Error

    • Anaplan Upload cannot create temp file to upload using Anaplan Java API

Binary

433patches21913

Fixed an issue with the File Writer Snap that caused slow performance when writing large files and the Flush interval was set to a positive value.

API Suite

433patches21959

Fixed an issue with the HTTP Client Snap that caused an intermittent connectivity issue, which resulted in a 404 error .

Snowflake

433patches21890

  • Enhanced the Snowflake - Bulk Load and Snowflake - Bulk Upsert Snaps with a new Flush chunk size (in bytes) field. When using internal staging, data is written to a temporary chunk file. When the file exceeds the specified size, it is copied to the Snowflake stage and deleted.

  • Added validation of external storage credentials for Snowflake S3 Accounts.

ML Core Snap Pack

433patches21854

Fixed an issue with the Cross

Validator (Classification) Snap where the native Windows DLL caused the Snaplex to stall

Validator (Classification) Snap where the native Windows DLL caused the Snaplex to stall.

🆕 SnapGPT

: Launched SnapGPT. SnapGPT is an AI-driven platform that lets you generate your pipelines using simple text prompts. Learn more.

To enable your Org for this feature, contact your Customer Success Manager (CSM).

API Management

New Features

...

  • Introducing the initial release of our third-party Observability tools integration feature in private beta. SnapLogic platform uses OpenTelemetry to support telemetry data integration with third-party Observability tools. This beta feature release includes implementing the service to enable the monitoring of your Pipeline execution runtime logs in Datadog. Learn more.

  • In Manager, you can configure notifications to receive an email or a Slack message when a node in a Snaplex fails or crashes. When you set a notification rule, a Snaplex node crash option is available under a Snaplex. To create, update, or manage notifications, refer to Manage Notifications. You can also view the node fail/crash information on the Manager > Alerts tab. A red triangle indicates the status of a new alert, and if the alert is older than an hour, the status is indicated by a gray triangle. To view alerts, refer to Viewing Alert Information.

  • For Ultra Tasks, you can now configure the Auto scaling of instances from the specific options to provide flexibility and the ability to respond to peak loads without manual intervention. This is a beta feature that requires a subscription for your Org. Learn more.

...

Enhancements

  • The Activity Log now displays Asset creation by import for pipelines and other assets. When you import a Project and select Create a new project, the Activity Log event description displays the Asset Create by Operation label. The description also indicates that the Project import operation created the Assets. Tasks are not included.

  • The APIM Public API Migrate an API version accepts a new request body parameter async_mode for asynchronous migration.

  • The APIM Public API Retrieve API Management logs returns more detailed time information for Ultra Tasks.

  • The Public API Retrieve activities in Org accepts the new value org_concurrent_call_limit for the query parameter filter_event_type. This returns events where the maximum number of concurrent pipeline executions for the Org was met or exceeded.

  • In the Git Integration dialog for Azure Repos, the Client ID field is deleted. The App ID field now takes the value from the Azure Repos setting of the same name. Learn more.

  • When an Org admin deletes a user from an Org, the user’s assets are first reassigned to the Org admin. After the owner transfer completes, the user is deleted. Previously, the delete user operation would hang if the user owned a large number of assets. Learn more.

  • In Manager, you can now select any Project under a specific Project Space when you copy the Assets. Learn more.

  • New application menu to navigate between the IIP Designer, IIP Manager (Classic Manager), Monitor (formerly Studio), and AutoSync:

...

  • Introduced the Google Analytics 4 Snap Pack, a cloud-based analytics platform that provides you the ability to gain deeper insights into user behavior, track conversions, and make data-driven decisions. This Snap Pack includes the following Snaps and account. (433patches21872):

  • Introduced the following new Snaps:

    • PGP Sign Snap: This Snap from the Binary Snap Pack allows binary data to be signed using PGPenables you to use PGP to sign a file digitally without encrypting the file. (433patches21870)

    • SuccessFactors Read Advanced Snap: This Snap from the SAP SuccessFactors Snap Pack enables you to read objects recursively for objects containing links to traverse through the tree structure. (main137)

...

  • The Aggregate, Group By Fields, Group By N, Join, Sort, Unique Snaps from the Transform Snap Pack now include new fields to improve memory management. (433patches21461)

  • The Amazon S3 Snaps automatically detect the Maximum session duration value for the Cross-Account IAM role (1 through 12 hours). The Snaps round down the value to the nearest hour. So, if the Snap administrator sets the Maximum session duration at 3 hours and 45 minutes, the Snaps read it as 3 hours. The Snaps also refresh the session before it expires. However, the automatic session refresh does not support the case of very large file upload or download that takes longer than the maximum session duration. (433patches21816)

  • The Decrypt Field and Encrypt Field Snaps from the Transform Snap Pack now support CTR (Counter mode) for the AES (Advanced Encryption Standard) block cipher algorithm. (433patches21779)

  • The Decrypt Field Snap now supports the decryption of various encrypted fields by providing a valid decryption key. (433patches21586)

  • The Deduplicate Snap now manages memory efficiently and eliminates out-of-memory crashes using the following fields: (433patches21572):

    • Minimum memory (MB)

    • Minimum free disk space (MB)

  • The Dynamics 365 for Sales Snaps include a new Enable continue on error checkbox to allow the Snap to continue executing the remaining batch requests, even if the previous request does not execute. (433patches21467)

  • The Dynamics365 for Sales Update Snap performs the update operation as expected when the Batch size is more than 1, and the Snap successfully executes when the batch size is 1. (433patches21467)

  • The pagination feature implemented for the ABFS protocol in the Hadoop Directory Browser Snap enables the Snap to return all the output documents as expected. (433patches21494)

  • The LDAP Search and LDAP Lookup Snaps now support a string representation for binary attributes using the Include string representation for binary attributes checkbox. (433patches21488)

  • The NetSuite Snap Pack now supports Customer-Subsidiary and Vendor-Subsidiary relationship Object types.
    Note: NetSuite's application requires the Oneworld extension for utilizing these subsidiary relationships, and Snap integration should use WSDL 2019_1 or later versions.
    (433patches21878)

  • The PGP Encrypt Snap now includes an Encryption key ID field, which allows you to specify the key ID for encrypting the data. If you do not specify an encryption key ID, the Snap uses the first key in the public key (master key). (433patches21482)

  • The SQL Server Snap Pack is upgraded to the Microsoft JDBC Driver 12.2.0.jre11 for SQL Server. Existing pipelines that do not use the default driver (bundled with the SQL Server Snap Pack) are not impacted. If you want to use NTLM or other authentications with the latest default driver (where the DLL file is mandatory), then you must copy the DLL file to the Snaplex path. Learn more about the SQL Server driver upgrade: FAQ for Upgrading to SQL Server JDBC Driver 12.2.0. (433patches21386)

...

  • Fixed an issue with the Azure Synapse SQL Bulkload Bulk Load Snap that caused a 404 error when the External Location was set to ADLS Gen2 and the Azure Folder field was not specified in the account settings. (433patches21718)

  • Fixed an issue with the HTTP Client Snap where the Snap now conceals the additional authentication headers in the debug information for Secured Headers Account. (433patches21860)

  • Fixed an issue with the SQL Server Insert Snap that was causing performance degradation between GA release 4.32 and 4.33 if the network connection between the Groundplex and the database server was slow. (433patches21808)

...

Breaking Changes

  • Pipelines that use the default Microsoft JDBC Driver in the SQL server accounts might be impacted after the upgrade because the latest driver is backward-incompatible. For more details, refer to the FAQ for Upgrading to SQL Server JDBC Driver 12.2.0. To prevent an impact to your accounts, reconfigure the URL properties field in account settings as follows: trustServerCertificate = true

  • With the 4.33 GA release, support for some algorithms for SFTP connection negotiation is removed to improve security and because we’ve updated the library used to connect to SFTP sources. We are working on a fix to automatically support the removed algorithms. With Snap Pack version 433patches21645, you can modify the global properties. Refer to Configuration Settings for Snaps for details about how to revert to the previous settings.

Known Issues

  • The Send Email Snap may fail because of a 429 error response from the Graph API endpoint.

  • The SFTP protocol is now incompatible with some deprecated algorithms. This affects mostly the Binary Snap Pack but might also apply to the Email Snap Pack. (433patches21482)

  • SFTP connections might experience connectivity issues because of the removal of some deprecated algorithms. To add these connections back, refer to Configuration Settings for Snaps for details.

...