Highlights
The SnapLogic October 2024 Release includes the following highlights:
Added the Amazon Bedrock Converse API Snap
Added the OpenAI Add Vector Store File, OpenAI List Files, OpenAI List Vector Store Files, OpenAI Remove Vector Store File, and OpenAI Upload File Snaps to the OpenAI LLM Snap Pack
The Execution overview now displays up to 500 child pipeline executions
Enhanced the System overview list view with information on CPU, disk, and memory use
Added the Kafka MSK IAM Account to the Kafka Snap Pack
Enhanced the GraphQL Client Snap with the Include extensions checkbox and improved the error handling in the Snap
Dot Releases: Platform
To take advantage of the following fixes, upgrade the Snaplexes in your environment (Org) to the designated version.
Date | Component | Version | Fixed Issues |
|---|---|---|---|
Snaplex |
|
| |
Snaplex |
|
|
Dot Releases: Snaps
Snap Pack | Date | Snap Pack Version | Updates |
|---|---|---|---|
| 438patches28655 | Added the following Snaps to the Amazon Bedrock LLM Snap Pack:
| |
| 438patches28655 | Enhanced the following Snaps with Advanced response configurations to customize response behavior that generates precise tuning of outputs: | |
| 438patches28655 | Added the following Snaps to the Azure OpenAI LLM Snap Pack:
Enhanced the following Snaps with Advanced response configurations to customize response behavior that generates precise tuning of outputs: | |
| 438patches28655 | Added the following Snaps to the OpenAI LLM Snap Pack:
Enhanced the following Snaps with Advanced response configurations to customize response behavior that generates precise tuning of outputs: | |
| 438patches28597 | Added the Message Appender Snap to the LLM Utilities Snap Pack that enables you to collect all the results from the Result Generator Snaps and append them to the | |
| 438patches28470 | Added the PipeLoop Snap that enables you to loop on pipeline executions based on a stop condition or iteration limit. The execution workflow of this Snap enables the parent pipeline to control and manage iterative processes using the child pipeline, for scenarios where repeated processing is needed until a specific stop condition is met. | |
| 438patches28567 | Fixed a token refresh issue with the GraphQL Client Snap (configured with the OAuth2 Account) wherein the access token expired before the periodic platform refresh, and the Snap displayed 401 and 403 errors. Now, the account refreshes the access token and retries query execution, ensuring seamless integration. | |
| 438patches28541 | The JDBC Snap Pack version
| |
| 438patches28439 | Updated the Kotlin library for SharePoint Online and Microsoft OneDrive Snap Packs with the | |
| 438patches28607 | Fixed an issue with the Salesforce Publisher Snap where an invalid session triggered infinite retries, resulting in many open file descriptors that eventually crashed the node. |
To view previous 4.38 patch versions, refer to the September Release Notes.
Admin Manager
Enhancements
The note in the UI for the Update Snaplex dialog box in the Downloads tab was updated to clarify that only the latest version download links are available for first-time installation.
API Management
Known Issues
Managing API keys with Secrets Management is temporarily unavailable, and we will be re-enabling it in a future release
Fixed Issues
URL encoding did not work when applied to a Proxy’s endpoint query parameters. For this fix, your Snaplex version should be
main-27456 - 4.38 Patch 2.
AutoSync
Known Issues
The AutoSync Snap Pack (438patches28270 and newer) now correctly maps Zendesk and Generic JDBC source NVARCHAR fields or columns to NVARCHAR. However, for existing target tables, change capture does not detect that existing VARCHAR fields and columns should be changed to NVARCHAR. To apply the fix to existing tables, follow the steps described in the second fixed issue in the next section.
Fixed Issues
The data preview for the Replace empty values screen no longer displays data from the wrong table when the selected table has no nullable columns.
For Zendesk and Generic JDBC sources, NVARCHAR fields or columns now load in the target correctly. To apply this fix:
Upgrade data pipelines with Zendesk or Generic JDBC sources to use the 438patches28270 (or newer) AutoSync Snap Pack.
Do one of the following:
Edit the appropriate data pipelines to use Full load, which drops the tables and reloads them. If necessary, change to Incremental or SCD2 after the first load.
Leave the load type as Incremental or SCD2 and manually drop the appropriate tables in the target.
Documentation Enhancements
View the list of help articles migrated to docs.snaplogic.com from the legacy documentation site.
New Videos
Dashboard to Monitor - Checking Snaplex health
Generate a Pipeline with SnapGPT
New Content
A new article describes the workflow for troubleshooting API request issues by performing deep dive analysis from the API Metric page.
This new tutorial explains how to assess the quality of your GenAI applications with our evaluation pipeline patterns:
GenAI App Builder - Evaluation Pipeline - Amazon Bedrock Edition
GenAI App Builder - Evaluation Pipeline - Azure OpenAI
GenAI App Builder
The Snaps mentioned in this section are deployed in the Latest set of Snap Packs. To access the latest features, an Environment admin must select the Snap Pack version in Classic Manager or Admin Manager.
New Features
Added the Amazon Bedrock Converse API Snap that enables you to generate message responses using the specified Converse API model and model parameters. This Snap supports all foundation models available in Amazon Bedrock.
Added the following Snaps to the OpenAI LLM Snap Pack:
OpenAI Add Vector Store File: Adds an existing file from OpenAI storage into the specified vector store using the vector store and file IDs.
OpenAI List Files: Retrieves and lists all files associated with the OpenAI account.
OpenAI List Vector Store Files: Retrieves and lists all vector store files based on the specified vector store ID.
OpenAI Remove Vector Store File: Removes a file from the specified vector store using the file ID.
OpenAI Upload File: Uploads a file to the specified vector store using the vector store and file IDs.
Enhancements
Enhanced the Amazon Bedrock Account with the Read timeout (seconds) field that enables the Snap to wait for a response from Amazon Bedrock.
Enhanced the following Snaps with the Stop sequences field to support stop sequences as a model parameter. You can specify the sequence of tokens or text to indicate to the model when to stop generating text:
Known Issues
For OpenAI List Vector Store Files, OpenAI documentation states that cancelled is a supported value for the Filter field; however, using this value might result in a
status code 400error from the endpoint.
Workaround: Use only the following supported values: completed, in_progress, and failed.
OpenAI Remove Vector Store File Snap may indicate a successful deletion in the output; however, the file might still appear in the output of the OpenAI List Vector Store Files Snap. This is a known bug from OpenAI. Learn more.
Monitor
Enhancements
The Execution overview table now displays up to 500 child pipeline executions. The previous limit in the ungrouped view was 100.
The System overview list view for nodes now includes information on CPU, disk, and memory usage:
The System overview list view now allows you to choose between all Snaplexes, all nodes, active nodes, or inactive nodes, as shown above. The graph view can display all Snaplexes, active nodes, or inactive nodes, as shown in the following screenshot:
The Node diagnostics table in the node details panel now organizes information to be easier to scan and interpret. The columns contain the current, recommended, minimum, and maximum values and the values out of the recommended range display in red in the top rows:
Known Issues
The Node status and Node type filters are missing from the System overview node view.
Platform
Enhancements
Task notifications now identify the environment (Org), Project Space, and project that contains the pipeline. When a pipeline is deleted before it runs, the notification displays the Project Space and project that contained the pipeline with a
pipeline deletedmessage.
Fixed Issues
Refer to the Dot Releases: Platform section for Fixed Issues.
Behavior Change
Task names no longer support commas (
,). Starting with this release, entering a comma in the Name field in the Task dialog results in a UI error message. Tasks existing before the October 2024 release are not affected, unless you modify the Task.
RFC compliance enforcement
Calls to SnapLogic APIs that contain non-RFC-compliant characters space: /? # [] @! $ & ' ( ) * +,; = need to be corrected by 9 PM PT. Please remove unencoded characters from the following:
Cloud Triggered Tasks
SnapLogic Public APIs
APIM and Ultra Tasks on SnapLogic-managed Cloudplexes
Note that this issue does not impact customers using the EMEA Control Plane.
Snaps
The Snaps mentioned in this section are deployed on the Latest distribution type. To access the Snaps from this release, Environment Admins must select the Snap Pack version in Admin Manager.
Important update from Snowflake about the Security Policies:
Snowflake recently signed the Cybersecurity and Infrastructure Security Agency (CISA) Secure By Design Pledge. In line with CISA’s Secure By Design principles, Snowflake recently announced several security enhancements in their platform — most notably the general availability of Trust Center and a new Multi-Factor Authentication (MFA) policy.
Effective October 2024, MFA will be enforced by default for all human users in any new Snowflake account. Service users (accounts designed for service-to-service communication) will not be subject to this MFA requirement.
Basic Authentication accounts:
If you currently use the Basic authentication to access Snowflake, we recommend one of the following:
Update your password to a maximum of 14 characters and a minimum of 8, and ensure it does not match any of the previous five passwords. Learn more.
Migrate to Key-Pair authentication: This method involves generating a public and private key pair, where the private key is securely stored and the public key is registered with your Snowflake account.
Migrate to OAuth2 authentication: This is a widely adopted standard for secure delegated access. It allows applications to obtain limited access to user accounts on an HTTP service, facilitating safer and more manageable authentication flows.
Implementing the above recommendations will secure your data and protect sensitive data, ensuring compliance with Snowflake's updated security policies. Learn more. For questions, contact support@snaplogic.com.
Upcoming
The JOOQ library will be upgraded from v3.9.1 to v3.17.x as the Latest release (following the November GA). Pipelines using the Generic - JDBC Snaps might be impacted by the jOOQ upgrade because the latest jOOQ version is not fully backward-compatible.
New Snaps/Accounts
Added the Kafka MSK IAM Account, which enables you to use IAM access control for secure communication with the MSK cluster. You can securely integrate your Kafka pipelines with the MSK cluster.
Enhancements
Enhanced the GraphQL Client Snap with the Include extensions checkbox to support extensions that enable you to access query content and extension data in a structure, similar to the GraphQL response. The non-standard fields in the GraphQL response are now ignored to avoid a possible error.
The GraphQL Client Snap now includes an improved error-handling mechanism that emulates how errors are reported in the raw GraphQL response. This enhancement provides additional context and pagination to the error output, which was previously limited to one page. Learn more.
Enhanced the S3 Download Snap with an Enable Staging checkbox that enables you to download an S3 object into a local temporary file. This enhancement addresses the cases where certain downstream Snaps take longer to process large volumes of data, potentially causing a connection reset error and pipeline failure.
Breaking Changes
JDBC Snap Pack:
Your existing pipelines that use the JDBC Snaps to integrate with Oracle or Redshift databases using the bundled Oracle or Redshift JDBC drivers will stop functioning with the
438patches28052.
Workaround: You must manually upload the Oracle or Redshift JDBC driver in the JDBC Database account to run your pipelines successfully.You can download the drivers using the following links:
Reltio Account deprecation by end of October 2024
Reltio has announced the deprecation of basic authentication using username and password for API access by the end of October 2024 to enhance their platform security. All customers must adopt client credentials and stop using username/password for API access immediately. Reltio will disallow API access using username/password by the end of October 2024. Client credentials are required for any integration or API usage with Reltio.
Consequently, SnapLogic has deprecated the Reltio Account in the October 2024 release. Any existing Reltio pipelines that rely on the current Reltio Account that uses a username/password for API access will not be supported by Reltio. To ensure the continuity of your pipelines, we recommend you to use the Reltio OAuth2 Account.
Behavior Changes
The GraphQL Client Snap now includes an improved error-handling mechanism that emulates how errors are reported in the raw GraphQL response. This enhancement provides additional context and pagination to the error output, which was previously limited to one page. Learn more.
Known Issues
When the Generic JDBC - Select and Generic JDBC - Execute Snaps connect to the Sybase database to retrieve BigTime type data, the Snaps display both date and time for the data type.
When you insert or update multiple records to the derive views using the Generic JDBC-Insert and Generic JDBC-Update with the Denodo instance, the Snaps fail with
[Failure: Batch operation failed, Reason: Batch operation failed]error.
Workaround:You must set the Batch size to 1 in the Generic Database Account when inserting multiple records.
Deprecated
The Reltio Account is deprecated and no longer available. Any existing Reltio pipelines that use the Reltio Account for API access will not be supported by Reltio. To ensure the continuity of your pipelines, we recommend that you use the Reltio OAuth2 Account.
SnapGPT
Enhancements
Improved the feedback mechanism for interactions.
Better quality and increased accuracy of the SnapGPT Q&A skill through applying a chunking strategy to the reference documents.
Fixed Issues
The Resize SnapGPT panel would not wrap properly around the Knowledge Skills window.
Behavior Change
If SnapGPT responses cannot provide an accurate response to a prompt, you receive the following message:
I’m not 100% confident about this answer but here are some related resources.