October 2024 Release Notes
Highlights
The SnapLogic October 2024 Release includes the following highlights:
Added the Amazon Bedrock Converse API Snap
Added the OpenAI Add Vector Store File, OpenAI List Files, OpenAI List Vector Store Files, OpenAI Remove Vector Store File, and OpenAI Upload File Snaps to the OpenAI LLM Snap Pack
The Execution overview now displays up to 500 child pipeline executions
Enhanced the System overview list view with information on CPU, disk, and memory use
Added the Kafka MSK IAM Account to the Kafka Snap Pack
Enhanced the GraphQL Client Snap with the Include extensions checkbox and improved the error handling in the Snap
Dot Releases: Platform
To take advantage of the following fixes, upgrade the Snaplexes in your environment (Org) to the designated version.
Date | Component | Version | Fixed Issues |
---|---|---|---|
Nov 8, 2024 | Snaplex |
|
|
Oct 22, 2024 | Snaplex |
|
|
Oct 17, 2024 | Snaplex |
|
|
Dot Releases: Snaps
Snap Pack | Date | Snap Pack Version | Updates |
---|---|---|---|
Nov 12, 2024 | 438patches29017 | Fixed an issue with the Teradata Snaps that caused errors because of invalid account credentials when the username or password included any of the following special characters:
| |
Nov 8, 2024 | 438patches28894 |
| |
Nov 7, 2024 | 438patches28723 |
| |
Nov 6, 2024 | 438patches28762 |
| |
Nov 5, 2024 | 438patches28906
|
| |
Nov 5, 2024 | 438patches28855 |
| |
Nov 5, 2024 | 438patches28891
|
| |
Nov 5, 2024 | 438patches28862
|
| |
Nov 5, 2024 | 438patches28829 | Reinstated support for the jTDS driver in the SQL Server Snap Pack. | |
Nov 5, 2024 | 438patches28744 | Added the NetSuite REST Transform Snap, which enables you to transform a record from one type to another within NetSuite. | |
Nov 1, 2024 | 438patches28811 | Fixed an issue with the Snowflake Snaps where the Snaps intermittently displayed an error requesting to | |
Nov 1, 2024 | 438patches28667 | Added the Snowflake - Snowpipe Streaming Snap that enables data insertion into Snowflake using the Snowpipe Streaming API. It allows for continuous data ingestion into Snowflake tables as soon as data becomes available. | |
Oct 31, 2024 | 438patches28852 | Fixed an issue with the Reltio OAuth2 Account that caused multiple refresh token calls. Now, the account refreshes the token based on its expiration time. | |
Oct 22, 2024 | 438patches28655 | Added the following Snaps to the Amazon Bedrock LLM Snap Pack:
Enhanced the following Snaps with Advanced response configurations to customize response behavior that generates precise tuning of outputs: | |
Oct 22, 2024 | 438patches28655 | Enhanced the Google Gemini Generate Snap with Advanced response configurations to customize response behavior that generates precise tuning of outputs. | |
Oct 22, 2024 | 438patches28655 | Added the following Snaps to the Azure OpenAI LLM Snap Pack:
Enhanced the following Snaps with Advanced response configurations to customize response behavior that generates precise tuning of outputs: | |
Oct 22, 2024 | 438patches28655 | Added the following Snaps to the OpenAI LLM Snap Pack:
Enhanced the following Snaps with Advanced response configurations to customize response behavior that generates precise tuning of outputs: | |
Oct 22, 2024 | 438patches28597 | Added the Message Appender Snap to the LLM Utilities Snap Pack that enables you to collect all the results from the Result Generator Snaps and append them to the | |
Oct 22, 2024 | 438patches28470 | Added the PipeLoop Snap that enables you to loop on pipeline executions based on a stop condition or iteration limit. The execution workflow of this Snap enables the parent pipeline to control and manage iterative processes using the child pipeline, for scenarios where repeated processing is needed until a specific stop condition is met. | |
Oct 22, 2024 | 438patches28567 | Fixed a token refresh issue with the GraphQL Client Snap (configured with the OAuth2 Account) wherein the access token expired before the periodic platform refresh, and the Snap displayed 401 and 403 errors. Now, the account refreshes the access token and retries query execution, ensuring seamless integration. | |
Oct 22, 2024 | 438patches28541 | The JDBC Snap Pack version
| |
Oct 21, 2024 | 438patches28439 | Updated the Kotlin library for Microsoft OneDrive Snap Packs with the | |
Oct 21, 2024 | 438patches28607 | Fixed an issue with the Salesforce Publisher Snap where an invalid session triggered infinite retries, resulting in many open file descriptors that eventually crashed the node. | |
AutoSync | Nov 19, 2024 | 438patches29076 | Fixed an issue loading to Databricks. To consume this fix for a version 4.38 AutoSync Snaplex or Groundplex, upgrade data pipelines with Databricks as a target to use the AutoSync 438patches29076 Snap Pack. |
To view previous 4.38 patch versions, refer to the September Release Notes.
Admin Manager
Enhancements
The note in the UI for the Update Snaplex dialog box in the Downloads tab was updated to clarify that only the latest version download links are available for first-time installation.
API Management
Known Issues
Managing API keys with Secrets Management is temporarily unavailable, and we will be re-enabling it in a future release
Fixed Issues
URL encoding did not work when applied to a Proxy’s endpoint query parameters. For this fix, your Snaplex version should be
main-27456 - 4.38 Patch 2
.
AutoSync
Known Issues
The AutoSync Snap Pack (438patches28270 and newer) now correctly maps Zendesk and Generic JDBC source NVARCHAR fields or columns to NVARCHAR. However, for existing target tables, change capture does not detect that existing VARCHAR fields and columns should be changed to NVARCHAR. To apply the fix to existing tables, follow the steps described in the second fixed issue in the next section.
Fixed Issues
The data preview for the Replace empty values screen no longer displays data from the wrong table when the selected table has no nullable columns.
For Zendesk and Generic JDBC sources, NVARCHAR fields or columns now load in the target correctly. To apply this fix:
Upgrade data pipelines with Zendesk or Generic JDBC sources to use the 438patches28270 (or newer) AutoSync Snap Pack.
Do one of the following:
Edit the appropriate data pipelines to use Full load, which drops the tables and reloads them. If necessary, change to Incremental or SCD2 after the first load.
Leave the load type as Incremental or SCD2 and manually drop the appropriate tables in the target.
Documentation Enhancements
View the list of help articles migrated to docs.snaplogic.com from the legacy documentation site.
New Videos
Dashboard to Monitor - Checking Snaplex health
Generate a Pipeline with SnapGPT
New Content
A new article describes the workflow for troubleshooting API request issues by performing deep dive analysis from the API Metric page.
This new tutorial explains how to assess the quality of your GenAI applications with our evaluation pipeline patterns:
GenAI App Builder - Evaluation Pipeline - Amazon Bedrock Edition
GenAI App Builder - Evaluation Pipeline - Azure OpenAI
GenAI App Builder
New Features
Added the Amazon Bedrock Converse API Snap that enables you to generate message responses using the specified Converse API model and model parameters. This Snap supports all foundation models available in Amazon Bedrock.
Added the following Snaps to the OpenAI LLM Snap Pack:
OpenAI Add Vector Store File: Adds an existing file from OpenAI storage into the specified vector store using the vector store and file IDs.
OpenAI List Files: Retrieves and lists all files associated with the OpenAI account.
OpenAI List Vector Store Files: Retrieves and lists all vector store files based on the specified vector store ID.
OpenAI Remove Vector Store File: Removes a file from the specified vector store using the file ID.
OpenAI Upload File: Uploads a file to the specified vector store using the vector store and file IDs.
Enhancements
Enhanced the Amazon Bedrock Account with the Read timeout (seconds) field that enables the Snap to wait for a response from Amazon Bedrock.
Enhanced the following Snaps with the Stop sequences field to support stop sequences as a model parameter. You can specify the sequence of tokens or text to indicate to the model when to stop generating text:
Known Issues
For OpenAI List Vector Store Files, OpenAI documentation states that cancelled is a supported value for the Filter field; however, using this value might result in a
status code 400
error from the endpoint.
Workaround: Use only the following supported values: completed, in_progress, and failed.
OpenAI Remove Vector Store File Snap may indicate a successful deletion in the output; however, the file might still appear in the output of the OpenAI List Vector Store Files Snap. This is a known bug from OpenAI. Learn more.
Monitor
Enhancements
The Execution overview table now displays up to 500 child pipeline executions. The previous limit in the ungrouped view was 100.
The System overview list view for nodes now includes information on CPU, disk, and memory usage:
The System overview list view now allows you to choose between all Snaplexes, all nodes, active nodes, or inactive nodes, as shown above. The graph view can display all Snaplexes, active nodes, or inactive nodes, as shown in the following screenshot:
The Node diagnostics table in the node details panel now organizes information to be easier to scan and interpret. The columns contain the current, recommended, minimum, and maximum values and the values out of the recommended range display in red in the top rows:
Known Issues
The Node status and Node type filters are missing from the System overview node view.
Platform
Enhancements
Task notifications now identify the environment (Org), Project Space, and project that contains the pipeline. When a pipeline is deleted before it runs, the notification displays the Project Space and project that contained the pipeline with a
pipeline deleted
message.
Fixed Issues
Behavior Change
Task names no longer support commas (
,
). Starting with this release, entering a comma in the Name field in the Task dialog results in a UI error message. Tasks existing before the October 2024 release are not affected, unless you modify the Task.
RFC compliance enforcement
Snaps
Upcoming
New Snaps/Accounts
Added the Kafka MSK IAM Account, which enables you to use IAM access control for secure communication with the MSK cluster. You can securely integrate your Kafka pipelines with the MSK cluster.
Enhancements
Enhanced the GraphQL Client Snap with the Include extensions checkbox to support extensions that enable you to access query content and extension data in a structure, similar to the GraphQL response. The non-standard fields in the GraphQL response are now ignored to avoid a possible error.
The GraphQL Client Snap now includes an improved error-handling mechanism that emulates how errors are reported in the raw GraphQL response. This enhancement provides additional context and pagination to the error output, which was previously limited to one page. Learn more.
Enhanced the S3 Download Snap with an Enable Staging checkbox that enables you to download an S3 object into a local temporary file. This enhancement addresses the cases where certain downstream Snaps take longer to process large volumes of data, potentially causing a connection reset error and pipeline failure.
Breaking Changes
Behavior Changes
The GraphQL Client Snap now includes an improved error-handling mechanism that emulates how errors are reported in the raw GraphQL response. This enhancement provides additional context and pagination to the error output, which was previously limited to one page. Learn more.
Known Issues
When the Generic JDBC - Select and Generic JDBC - Execute Snaps connect to the Sybase database to retrieve BigTime type data, the Snaps display both date and time for the data type.
When you insert or update multiple records to the derive views using the Generic JDBC-Insert and Generic JDBC-Update with the Denodo instance, the Snaps fail with
[Failure: Batch operation failed, Reason: Batch operation failed]
error.
Workaround:You must set the Batch size to 1 in the Generic Database Account when inserting multiple records.
Deprecated
The Reltio Account is deprecated and no longer available. Any existing Reltio pipelines that use the Reltio Account for API access will not be supported by Reltio. To ensure the continuity of your pipelines, we recommend that you use the Reltio OAuth2 Account.
SnapGPT
Enhancements
Improved the feedback mechanism for interactions.
Better quality and increased accuracy of the SnapGPT Q&A skill through applying a chunking strategy to the reference documents.
Fixed Issues
The Resize SnapGPT panel would not wrap properly around the Knowledge Skills window.
Behavior Change
If SnapGPT responses cannot provide an accurate response to a prompt, you receive the following message:
I’m not 100% confident about this answer but here are some related resources.
Have feedback? Email documentation@snaplogic.com | Ask a question in the SnapLogic Community
© 2017-2024 SnapLogic, Inc.