...

...

...

...

...

...

...

...

...

The SnapLogic^{May 2024 release includes the following:}

Admin Manager

• Collapsible navigation pane

API Management

• New public API for Git Integration Operations for API version

• API Metrics now available in Monitor

• New public API to perform soft delete on the API and API version

• A JWT Outbound policy is now available for Proxies

AutoSync

• Merge columns transformation to concatenate data

• Interface to update data pipelines to the latest AutoSync Snap Pack

• New target endpoints: Databricks, Amazon S3, and Azure Data Lake Storage (ADLS) Gen2

Data Automation

• Load flat and nested data sets from Parquet files to Snowflake with the ELT Load Snap

Documentation Updates

• ML Analytics and ML Natural Language Processing Snap Packs are published on the new Documentation site.

• Video on adding a Response Transformer Policy to a Proxy.

GenAI Builder

• Added the Anthropic Claude on AWS Messages Snap to the Amazon Bedrock Snap Pack

Monitor

• New pages:

  • Alert history

  • Integration catalog

Platform

• New Git Integration public API to discard local changes

• New public API to create, update, and delete a Groundplex

• Modified public API for sending a notification email when a user is added

Snaps

• The Azure SQL Bulk Extract Snap now supports the Azure SQL Entra and Azure SQL Entra Dynamic Accounts

• Added support for Geospatial data types (Geography and Geometry) for the SQL Server Snap Pack

• Added the MongoDB Execute and MongoDB - Atlas Vector Search Snaps to the MongoDB Snap Pack

• Added the NetSuite Add List and NetSuite Async Add List Snaps to the NetSuite SOAP Snap Pack

• Added Parquet Parser and Parquet Formatter Snaps to the Transform Snap Pack

SnapGPT

• Improved UX

Dot Releases - Snaps

Upgrading to this Release

Admin Manager

New Features

• The left navigation and header for Admin Manager have a new design. You can collapse the left navigation pane to increase space for the main panel and expand it to view page names:
  

  Image Removed

• AutoSync environment admins can now update the AutoSync Snap Pack version on the AutoSync settings page. Learn more.
  

  Image Removed

• The browser tab label now identifies Admin Manager and the name of the current page:
  

  Image Removed

Upgrading to this Release

Admin Manager

New Features

• The left navigation and header for Admin Manager have a new design. You can collapse the left navigation pane to increase space for the main panel and expand it to view page names:
  

  Image Added

• AutoSync environment admins can now update the AutoSync Snap Pack version on the AutoSync settings page. Learn more.
  

  Image Added

• The browser tab label now identifies Admin Manager and the name of the current page:
  

  Image Added

API Management

New Features

...

• The Infer data types for CSV files checkbox now only displays for the S3 and SFTP endpoints for CSV files, not for JSON files.

• For the ServiceNow endpoint, AutoSync ignores the maximum length defined by ServiceNow for string and decimal types and uses the default precision of the target.

Data Automation

Enhancements

• Enhanced the ELT Load Snap’s capabilities to allow loading flat and nested data sets (from canonical and non-canonical formats) from your Parquet files to the target tables in Snowflake. Learn more about the usage of this feature at Load data from Parquet files and in the following example pipelines:

  • Load data from a canonical format Parquet file

  • Load data from a non-canonical format Parquet file

Automation

Enhancements

• Enhanced the ELT Load Snap’s capabilities to allow loading flat and nested data sets (from canonical and non-canonical formats) from your Parquet files to the target tables in Snowflake. Learn more about the usage of this feature at Load data from Parquet files and in the following example pipelines:

  • Load data from a canonical format Parquet file

  • Load data from a non-canonical format Parquet file

Fixed Issue

• Fixed an issue where the ELT Merge Into Snap failed to load data into the Google BigQuery target table because of the error: Number of source column expressions in the input SQL is greater than the target table columns (even after altering the target table to match the source table columns). The resolution was to modify an SQL statement that was used internally to achieve the merge action.

Documentation Updates

Content Published on New Documentation Site

...

• New support for AWS Secrets Manager to restrict secrets access by SnapLogic projects. To restrict access to specific projects, add role-based IAM aliases for them to a secrets-config.json file and restart your Groundplex nodes. Learn more.

• The header for Designer, Manager, and Dashboard has a new look:
  

  

• The user settings menu, which is available from a dropdown next to the user’s name, has a new design:

  • Settings are categorized as global or application-specific settings.

  • Non-admin users can’t change their username, they must ask an Environment admin to change it.
    The screenshot on the left shows the menu for Admin Manager, AutoSync, and Monitor. The screenshot on the right shows the menu for Dashboard and Manager:
    

    

• Browser tab labels now identify the app and page name:
  

• Open Telemetry reporting to third-party monitoring and logging tools now only sends messages labeled Error in severity level. Previously, messages marked Informational were also included. These Informational messages are still retained in the logs.

Fixed Issues

• Fixed an issue for the toPrecision() function that converts the data incorrectly when processing a whole number. When you call the function with arguments greater than 100, it results in an error.

Snaps

Upcoming

...

• still retained in the logs.

Fixed Issues

• Fixed an issue for the toPrecision() function that converts the data incorrectly when processing a whole number. When you call the function with arguments greater than 100, it results in an error.

Upcoming behavior change

Project-level pipeline execution behavior change

Currently, tasks stored in a Project Space of an Org can be executed by pipelines in a different Project Space or even from requests from a different Org. There is an upcoming fix to stop this behavior in the July release. After the fix is deployed, tasks must belong to the same Project Space as the pipeline Project Space they are called from to be successfully executed.

Known Issues

• When creating a Task and selecting the America/Mexico City time zone, the task runtime is off by one hour. Since Mexico City no longer observes daylight savings, the current implementation of CDT (aligned with CST) might assume that Mexico City changed time zones as it did in the past.
  Workaround: Upgrade your Snaplex to a JDK 11.0.18+ version.

Snaps

Upcoming

...

• The following Azure Active Directory-related Snaps and Accounts have been renamed becauseMicrosoft has rebranded Azure Active Directory to Microsoft Entra ID.

• Enhanced the Google Directory Read Snap with an On empty result dropdown list that enables you to select the Snap behavior when no matching filter value is found.

• Enhanced the JSON Splitter Snap to capture metadata and lineage information from the input document.

• Kafka Snap Pack: Enhanced the following fields to support expressions through pipeline parameters:

  • Truststore Password

  • Keystore File Password

  • SSL Key Password

  • SASL Password or Secret

  • Registry Password or Secret

• Enhanced the MongoDB Update Snap with the Array Filters field, which enables you to use array filters in the update operation. Additionally, the Update Query field is now modified into a text box for visibility and usability of input queries.

• Increased the default Read timeout value for NetSuite REST Snaps from 60 to 300 seconds. This update supports longer-running operations and prevents early disconnections for complex data processing tasks.

• Updated the Delete Condition (Truncates a Table if empty) field in the following Database Delete Snaps to Delete condition (deletes all records from a table if left blank) to indicate that all entries will be deleted from the table when this field is blank, but no truncate operation is performed.

  • AlloyDB Delete

  • Azure Synapse SQL Delete

  • Databricks - Delete

  • MySQL - Delete

  • Oracle - Delete

  • PostgreSQL - Delete

  • Redshift - Delete

  • SAP HANA - Delete

  • Snowflake - Delete

  • SQL Server - Delete

  • Vertica - Delete

• Enhanced the HubSpot Snaps with the Retry policy field to handle retries for connection and error responses.

• Updated the following NetSuite SOAP Snap names for usability based on the functionality of the Snaps:

...

• Fixed an SMB (server message block) connectivity issue in the Binary Snap Pack, where the incorrect name provided by the SMB client did not match the Windows cluster virtual name, affecting the SPN (service principal name) connection.

• Fixed a performance issue in the Copy Item Snap, which previously resulted in a nameAlreadyExists error when the Snap retried because of a connection reset.

• Fixed an issue with the OpenAPI Snap where the upstream Mapper Snap did not display the full schema objects in the Target Schema.

• Fixed an issue with the Oracle - Bulk Load Snap that intermittently displayed a null pointer exception.

• Fixed the following issues with the SQL Server Snap Pack:

  • Snaps displayed an error when numeric values with scale 0 were inserted into the database with DECIMAL or NUMERIC type columns instead of inserting the value with decimal digits truncated.

  • Snaps displayed an error when fractional numeric values (numbers with a decimal point) were inserted into the database with an INT type column, instead of inserting the values with decimal digits truncated.

Known Issues

• The SQL Server - Bulk Load Snap returns 0 rows copied for tables containing spatial-type columns.

...