...

The SnapLogic^{January 2025 Release includes the following highlights:}

AgentCreator

• Added support for the Assistants tool calling with for the Azure OpenAI Assistants and in the Google GenAI Snap Pack via Gemini

• Added support to manage vector stores and files for vector stores in Azure OpenAI Snap Pack

• Added the Google GenAI Snaps to enable seamless tool integration by allowing models to call external tools, define tool usage, and format function results into a unified structure

Monitor

• New table component for pipeline executions

Platform

• New Public API to retrieve Snaps and Snap Pack statistics

Snaps

• Enhanced Teradata Snaps with the Query band field that logs the SnapLogic pipeline, project, and Teradata database information in Teradata

SnapGPT

• Improved the quality of answers and generated expressions and enhanced the feedback loop

Platform Updates

Dot Releases: Snaps

Upgrading to this Release

...

• Azure OpenAI LLM:

  • Added the following Snaps to the Snap Pack:

    • Azure OpenAI Assistants Submit Tool Outputs: Submits a list of tool outputs to be fed back into the model as input for further processing by calling the Submit tool outputs to run the API.

    • Azure OpenAI Assistants Tool Call Router: Routes the input run object into two output views. The first output view passes the run object from the input, which also consists of an empty array, whereas and the second output view includes the list of tools to be called.

    • Azure OpenAI Add Vector Store File: Adds an existing file from Azure OpenAI storage into the specified vector store using the vector store and file IDs.

    • Azure OpenAI Create Vector Store: Creates a new vector store associated with your account.

    • Azure OpenAI List Files: Retrieves and lists all files associated with the Azure OpenAI account.

    • Azure OpenAI List Vector Store Files: Retrieves and lists all vector store files based on the specified vector store ID from Azure OpenAI.

    • Azure OpenAI Remove Vector Store File: Removes a file from the specified vector store using the file ID from Azure OpenAI.

• Google GenAI LLM:

  • Added the following Snaps to the Snap Pack:

    • Google Gemini API Tool Calling: Provides external tools for the model to call, supplying internal data and information for the model's response.

    • Google GenAI Function Generator: Generates a tool definition in the output to inform the model about the tools that you want to call.

    • Google GenAI Function Result Generator: Formats the results generated by user-run functions into a unified structure within SnapLogic.

Enhancements

• Amazon Bedrock LLM:

  • The Amazon Bedrock Function Result Generator Snap now supports boolean values from the upstream Snap in the Is Error field, which previously supported only supported pipeline parameters. If the field is left empty, the Snap issues a lint warning indicating to indicate that the default value (false) is used.

  • The SdkNumber data type returned by the Amazon Converse API tool is now converted to BigDecimal data type which is supported by the SnapLogic Platform, to ensure seamless processing of numeric inputs.

• Azure OpenAI LLM:

  • Enhanced the Create and Run Thread and Run Thread Snaps to support the tool calling capability specifically for the assistants within in the Azure OpenAI Snap Pack.

• Amazon Bedrock LLM, Azure OpenAI LLM, and OpenAI LLM:

  • Enhanced the Amazon Bedrock Function Generator, Azure OpenAI Function Generator, and OpenAI Function Generator Snaps to validate the names of functions based on the requirements for the individual providers' requirements.

  • Enhanced the Azure OpenAI Function Result Generator and OpenAI Function Result Generator Snaps with the Metadata field set that supports custom key-value pairs configuration. This feature enables you to pass specific metadata from the function pipeline, such as function execution details captured through in logs.

API Management

Fixed Issues

...

• New option to have AutoSync write error records to the PostgreSQL target.

Behavior

...

Change

• When CSMs enable AutoSync for an environment with Enhanced Account Encryption (EAE), an AutoSync Cloudplex will no longer be automatically provisioned. Environments with EAE must use Groundplexes to run AutoSync data pipelines and cannot have a mix of Cloudplexes and Groundplexes. Learn more.
  The steps required to use EAE with AutoSync depend on the timing of feature enablement and configuration:

  • If EAE is enabled and configured (not just subscribed) before AutoSync, no action is required. No AutoSync Snaplex is provisioned. Data pipeline designers simply select the appropriate Groundplex.

  • If AutoSync is enabled before EAE is configured or if the features are subscribed at the same time, an AutoSync Snaplex will be provisioned. The AutoSync Snaplex must be removed for EAE to work properly.
    Refer to the documentation for the full details.

...

• The following Asset catalog column filters now work correctly for tasks: task Name, Status, Source, Destination, Account, Created by. On the Pipelines tab, the following filters now work: Pipeline Name, Created date, and Updated date.

• Monitor now correctly displays child pipeline executions under their parent.

...

• When you have read and execute permission to a project and validate a pipeline, SnapLogic Designer does not display the validation data in the Data Preview page. To view the validation date, you must have full permission to the project.

• The SnapLogic Data Lineage Collection implementation constructs the schema from the first document processed. If subsequent documents have a different schema – one that includes more elements – those elements won’t appear in the lineage output.

• Auto-scaling in Kubernetes causes the pipelines to fail after a node is placed in maintenance mode.

Snaps

...

• Google BigQuery:

  • The BigQuery Bulk Load (Cloud Storage) Snap now displays a lint warning when the bulk load process completes successfully but the temporary file deletion fails.

  • Enhanced the following Google BigQuery Snaps with implicit retry functionality to improve the reliability of CRUD operations in BigQuery and handle all retriable BigQuery by retrying after errors:

    • BigQuery Write

    • BigQuery Table Delete

    • BigQuery Table Data List

    • BigQuery Table Create

    • BigQuery Execute

    • BigQuery Dataset List

    • BigQuery Dataset Delete

    • BigQuery Dataset Create

    • BigQuery Table List

    • BigQuery Bulk Load (Cloud Storage)

• Teradata: Enhanced the following Teradata Snaps with the Query band field that logs the SnapLogic pipeline, project, and Teradata database information in Teradata to help associate metadata with each query when it is executed:

  • TPT FastExport

  • Teradata FastExport

  • Teradata FastLoad

  • Teradata Select

  • Teradata Execute

  • TPT Load

• Renamed See add-on Snap Pack to View Premium Snap Packs in Snap Catalog.

  • Watch how to subscribe to request trials for Premium Snap Packs.:

    Subscribe to the Premium Snap Packs.mp4

• Similar to the Pipeline Execute Snap, you can now hover over a Pipeloop Snap to preview the child pipeline.

...