Highlights

The SnapLogic January 2025 Release includes the following highlights:

AgentCreator

• Added support for tool calling with the Azure OpenAI Assistants and in the Google GenAI Snap Pack via Gemini

• Added support to manage vector stores and files for vector stores in Azure OpenAI

Monitor

• New table component for pipeline executions

Platform

• New Public API to retrieve Snaps and Snap Pack statistics

Snaps

• Enhanced Teradata Snaps with the Query band field that logs the SnapLogic pipeline, project, and Teradata database information in Teradata

SnapGPT

• Improved the quality of answers and generated expressions and enhanced the feedback loop

Upgrading to this Release

Admin Manager

Enhancements

• The page that gives Environment admins the option to add a link to a custom General Data Protection Regulation (GDPR) privacy notice in the App menu is renamed from GDPR privacy notice to Custom privacy notice.

AgentCreator

New Features

• Azure OpenAI LLM:

  • Added the following Snaps to the Snap Pack:

    • Azure OpenAI Assistants Submit Tool Outputs: Submits a list of tool outputs to be fed back into the model as input for further processing by calling the Submit tool outputs to run API.

    • Azure OpenAI Assistants Tool Call Router: Routes the input run object into two output views. The first output view passes the run object from the input, which also consists of an empty array, whereas the second output view includes the list of tools to be called.

    • Azure OpenAI Add Vector Store File: Adds an existing file from Azure OpenAI storage into the specified vector store using the vector store and file IDs.

    • Azure OpenAI Create Vector Store: Creates a new vector store associated with your account.

    • Azure OpenAI List Files: Retrieves and lists all files associated with the Azure OpenAI account.

    • Azure OpenAI List Vector Store Files: Retrieves and lists all vector store files based on the specified vector store ID from Azure OpenAI.

    • Azure OpenAI Remove Vector Store File: Removes a file from the specified vector store using the file ID from Azure OpenAI.

• Google GenAI LLM:

  • Added the following Snaps to the Snap Pack:

    • Google Gemini API Tool Calling: Provides external tools for the model to call, supplying internal data and information for the model's response

    • Google GenAI Function Generator: Generates a tool definition in the output to inform the model about the tools that you want to call.

    • Google GenAI Function Result Generator: Formats the results generated by user-run functions into a unified structure within SnapLogic.

Enhancements

• Amazon Bedrock LLM:

  • The Amazon Bedrock Function Result Generator Snap now supports boolean values from the upstream Snap in the Is Error field, which previously only supported pipeline parameters. If the field is left empty, the Snap issues a lint warning indicating that the default value (false) is used.

  • The SdkNumber data type returned by the Amazon Converse API tool is now converted to BigDecimal data type which is supported by the SnapLogic Platform, to ensure seamless processing of numeric inputs.

• Azure OpenAI LLM:

  • Enhanced the Create and Run Thread and Run Thread Snaps to support the tool calling capability specifically for the assistants within the Azure OpenAI Snap Pack.

• Amazon Bedrock LLM, Azure OpenAI LLM, and OpenAI LLM:

  • Enhanced the Amazon Bedrock Function Generator, Azure OpenAI Function Generator, and OpenAI Function Generator Snaps to validate the names of functions based on the requirements for the individual providers.

  • Enhanced the Azure OpenAI Function Result Generator and OpenAI Function Result Generator Snaps with the Metadata field set that supports custom key-value pairs configuration. This feature enables you to pass specific metadata from the function pipeline, such as function execution details captured through logs.

API Management

Fixed Issues

• The Description field in the API Documentation page on the Developer Portal now displays the full text on the page and is no longer truncated.

AutoSync

Enhancements

• New option to have AutoSync write error records to the PostgreSQL target.

Behavior change

• When CSMs enable AutoSync for an environment with Enhanced Account Encryption (EAE), an AutoSync Cloudplex will no longer be automatically provisioned. Environments with EAE must use Groundplexes to run AutoSync data pipelines and cannot have a mix of Cloudplexes and Groundplexes. Learn more.
  The steps required to use EAE with AutoSync depend on the timing of feature enablement and configuration:

  • If EAE is enabled and configured (not just subscribed) before AutoSync, no action is required. No AutoSync Snaplex is provisioned. Data pipeline designers simply select the appropriate Groundplex.

  • If AutoSync is enabled before EAE is configured or if the features are subscribed at the same time, an AutoSync Snaplex will be provisioned. The AutoSync Snaplex must be removed for EAE to work properly.
    Refer to the documentation for the full details.

Monitor

Enhancements

• Changes that you make to Asset catalog table columns are now persisted across login sessions. This includes showing, hiding, rearranging, filtering, sorting, and changing the row height (normal or compact).

• The Execution overview is now named Pipeline executions and no longer contains status cards. Learn more.
  Usability improvements to the table of pipeline executions include:

  • Easy access to filterable columns from the column header and from the Table configuration and filters dialog.

  • Quick sort from the header of columns that support sorting.

  • The hierarchy of parent and child pipelines is visible when you expand the parent.

  • Option to use compact row spacing to fit more rows in the display.

Fixed Issues

• The following Asset catalog column filters now work correctly: task Name, Status, Source, Destination, Account, Created by. On the Pipelines tab, the following filters now work: Pipeline Name, Created date, and Updated date.

• Monitor now correctly displays child pipeline executions under their parent.

Known Issues

• The Asset catalog incorrectly displays deleted pipelines on the Pipelines tab.

• The Pipeline executions page can show incorrect results when opened from the Asset catalog. This happens when an environment has multiple pipelines with the same name, but in different projects. If you click the View executions link from a pipeline’s details, executions for all pipelines with that name display instead of just those for the selected pipeline.

Platform

New features

• The new Snap statistics public API retrieves Snap Pack statistics and provides detailed data, including the number of pipelines, pipeline names, project paths, and Org names. Learn more.

Enhancements

• Updated instructions for deploying an OpenTelemetry (Otel) collector on Windows servers that host Groundplex nodes. This supports third-party observability tools, such as Datadog and New Relic.

Fixed Issues

• The Project Migration Public API now works for the global shared project in your environment (Org).

• Git access to files in a renamed project now works correctly. Previously, if you renamed a project, you could no longer access files tracked by Git.

Known Issues

• When you have read and execute permission to a project and validate a pipeline, SnapLogic Designer does not display the validation data in the Data Preview page. To view the validation date, you must have full permission to the project.

• The SnapLogic Data Lineage Collection implementation constructs the schema from the first document processed. If subsequent documents have a different schema – one that includes more elements – those elements won’t appear in the lineage output.

Snaps

Enhancements

• Google BigQuery:

  • The BigQuery Bulk Load (Cloud Storage) Snap now displays a lint warning when the bulk load process completes successfully but the temporary file deletion fails.

  • Enhanced the following Google BigQuery Snaps with implicit retry functionality to improve the reliability of CRUD operations in BigQuery and handle all retriable BigQuery errors:

    • BigQuery Write

    • BigQuery Table Delete

    • BigQuery Table Data List

    • BigQuery Table Create

    • BigQuery Execute

    • BigQuery Dataset List

    • BigQuery Dataset Delete

    • BigQuery Dataset Create

    • BigQuery Table List

    • BigQuery Bulk Load (Cloud Storage)

• Teradata: Enhanced the following Teradata Snaps with the Query band field that logs the SnapLogic pipeline, project, and Teradata database information in Teradata to help associate metadata with each query when it is executed:

  • TPT FastExport

  • Teradata FastExport

  • Teradata FastLoad

  • Teradata Select

  • Teradata Execute

  • TPT Load

• Renamed See add-on Snap Pack to View Premium Snap Packs in Snap Catalog.

  • Watch how to subscribe to Premium Snap Packs.

    Subscribe to the Premium Snap Packs.mp4

• Similar to the Pipeline Execute Snap, you can now hover over a Pipeloop Snap to preview the child pipeline.

SnapGPT

Enhancements

• Improved the accuracy of answers to questions. SnapGPT now has access to more source material, including documentation and community posts. SnapGPT provides links to the sources it used for the answer. If it detects a possible hallucination, SnapGPT lets you know that it is not sure about the result and provides related resources for you to check.

• Improved expression generation. SnapGPT now only presents valid expressions for you to select.

• Improved the feedback loop. If you click thumbs-down, a box displays with possible reasons, as shown below. Your detailed feedback helps us improve SnapGPT quality.