Highlights

The SnapLogic April 2024 Release includes the following:

API Management

• New public API to approve, deny, and view pending user IDs

AutoSync

• Remove a table that fails to load from a data pipeline with one click

Documentation Updates

• A video that demonstrates how to configure a Workday account and execute a WorkdayQL query

GenAI Builder

• Added the Amazon Bedrock LLM Snap Pack

Monitor

• A new Activity logs page is available to admin users

Platform

• Add user to Org API allows users to be added to an Org

• Export/Import individual asset API has the ability to export/import and list individual assets

Snaps

• The Azure SQL Bulk Extract Snap now supports the Azure SQL Active Directory and Azure SQL Active Directory Dynamic Accounts

• Added the MongoDB Execute Snap to the MongoDB Snap Pack

• Added the NetSuite Add List and NetSuite Async Add List Snaps to the NetSuite SOAP Snap Pack

• Added support for XML and spatial types (Geography and Geometry) for the SQL Server Snap Pack

Dot Releases - Platform

Dot Releases - Snaps

API Management

New Features

• A new public API now lists pending users for the Developer Portal and provides the ability to approve or deny their membership.

Enhancements

• The copy asset operation for API Versions now adds all Project Spaces and subfolders to the source folder picker. Previously, you had to copy the assets to the global shared folder first, then do the copy operation in APIM.

Fixed Issues

• Fixed an issue where the Migrate Proxy Public API migrated Subscriptions, causing errors in the destination Org when using the Proxy.

• Fixed an issue where the GIT Discard Changes Public API did not work and resulted in an HTTP 400 response.

• Fixed an issue with the Create API from existing assets workflow where the correct account type was not recognized.

AutoSync

New Features

• AutoSync now gives you the option to remove tables that failed to load from the data pipeline. Such failures can occur when a table has been removed from the source or for other reasons. Re-run the integration to make sure the issues have been resolved. Learn more.

Fixed Issues

• For the MySQL target endpoint, columns with the TIME datatype now have the correct precision. To take advantage of this fix, you need to use the latest MySQL Snap Pack version.

• For the ServiceNow source endpoint, AutoSync can now load tables from the global scope and the private application scope. When you select tables, AutoSync populates the list with the first 2000 tables from your ServiceNow account. Use search to find tables that don't display on the list.

• The preview data in the data pipeline wizard now refreshes correctly when you navigate forward or back through the transformation screens.

• For CSV file loads with type inference enabled, AutoSync treats empty strings as null values.

• Data pipelines loading to Google BigQuery using SCD2 no longer incorrectly report an error for successful loads. Previously, this error only occurred when loading to a single region dataset when the credentials specified a location.

Known Issues

• Records can be updated incorrectly in a data pipeline using Incremental load with a Snowflake target if the credentials were created in AutoSync Manager or Classic Manager and they do not specify a Timezone Url Property. Without this property, the timestamp in the source and target can differ. Credentials created in AutoSync handle this automatically so that Incremental load works correctly.
  Workaround: To create Snowflake credentials in AutoSync Manager or Classic Manager, in the Advanced Properties section, click + to add a Url Property. Enter Timezone as the name and UTC as the value.

• To use accounts created in Classic Manager or Designer for the following endpoints, you must add an AutoSync-specific tag in the Info tab of the account:

  • Gainsight PX: autosync_gainsightpx

  • HTTP client: autosync_httpclient

  • Zendesk: autosync_zendesk

Documentation Updates

Enhancements

• The information on configuring SSO in Classic Manager and Admin Manager has been improved. It also now describes how to configure SSO for multiple environments (Orgs).

Content Published on New Documentation Site

You can find the following content on docs.snaplogic.com:

• Cloudplexes

• Groundplexes in Admin Manager (new UI)

  • Requirements

  • Installation details

Videos

• Configure a Workday REST OAuth2 Account and use WorkdayQL Snap: This video demonstrates how to configure a Workday REST OAuth2 Account and execute a WorkdayQL query.

GenAI Builder

• Introduced the Amazon Bedrock LLM Snap Pack, which contains the following Snaps and Account:

  • Amazon Titan Chat Completions: Generates chat completions using the specified Amazon Titan Text model and model parameters.

  • Amazon Titan Embedder: Generates an embedding vector based on the input data.

  • Amazon Bedrock Prompt Generator: Generates the augmented user prompt as per the specified prompt template.

  • Anthropic Claude on AWS Chat Completions: Generates chat completions using the specified Anthropic Claude model and model parameters.

  • Amazon Bedrock Account: Authenticates with Amazon Bedrock's services using the specified Access and Secret access key for secure and authorized access to foundation models and LLM capabilities.

Monitor

New Features

• Enhanced user-friendly Activity Log interface to effectively track changes across user accounts, assets, policies, and other critical components. Learn more.

Enhancements

• Notifications by email that include runtime information on pipeline execution now include a clickable link that opens the Monitor Execution overview record for that execution.

• Labels in Metrics charts and the corresponding documentation have been improved. Learn more.

• The search results in the Execution overview now include both parent and child executions when either of them matches the search criteria. The parent-child hierarchy is not preserved when you group the table by pipeline or task.

Known Issues

• The Activity log subscriptions and unsubscription events are tracked by the Environment (Org) admin under the All filter in Admin Manager.

Platform

New Features

• Added a public API to add users to an environment (Org). Learn more

• Added public APIs to export or import individual assets.

Enhancements

The Activity Log tracks subscriptions, unsubscription events, and Snap Pack version updates. Learn more

Fixed Issues

• All the existing Snaplex node cpu load avg notifications are now enabled. This issue was fixed after the Snaplex Mandatory Automatic Upgrade, completed on Saturday, Mar 16, 2024.

• Fixed a UI issue for an existing node cpu load avg notification which was disabled earlier.

Snaps

Upcoming

New Snaps/Accounts

• Added the MongoDB Execute Snap to the MongoDB Snap Pack.

• Added the following Snaps to the NetSuite SOAP Snap Pack:

  • NetSuite Add List: Adds a list of records in bulk to NetSuite.

  • NetSuite Async Add List: Inserts a list of records in NetSuite asynchronously, and the Snap returns a job ID after a successful operation.

Enhancements

• Upgraded the jOOQ library of the Azure Synapse SQL and Cassandra Snap Packs from v3.9.1 to v3.17.x. These upgrades are deployed as the latest distribution (436patches25597) on April 10, 2024, and will be part of the stable distribution with the GA release on May 8, 2024.

• The Azure SQL Bulk Extract Snap now supports the Azure SQL Active Directory and Azure SQL Active Directory Dynamic Accounts.

• Enhanced the HTTP Client Snap to optimize memory usage by accumulating the Request History objects only when you select the Enable debug checkbox. Now, the Snap displays only debug information and lint warnings (in both the Error and Output views) when you select the Enable debug checkbox.

• Enhanced the JWT Account to support Secret key authentication.

• Enhanced the NetSuite REST Snap Pack to optimize memory usage for long-running pipelines.

• Enhanced the Salesforce Bulk Create, Bulk Delete, Bulk Update, and Salesforce Bulk Upsert Snaps to include the complete error details under the original object that contains the copies of the failed input records.

• Enhanced the Snowflake Bulk Load Snap to fetch the file format types based on the selected Datasource. When the Datasource is Input view, the Snap supports only CSV and NONE file format types (as a Suggestions list).

• Updated the Snowflake Bulk Upsert Snap to support only CSV and NONE file format types (as a Suggestions list).

• Added support for XML and spatial types (Geography and Geometry) for the SQL Server Snap Pack.

Behavior Changes

• The jOOQ upgrade for the Azure Synapse SQL and Cassandra Snap Packs from v3.9.1 to v3.17.x resulted in the following behavior changes:

• As part of the jOOQ upgrade done in main25112, the SQL Server - Insert Snap displayed the following error when an empty string was inserted into an integer-type column:
  Caused by: java.lang.NumberFormatException: Character n is neither a decimal digit number, decimal point, nor "e" notation exponential mark
  Now, the Snap inserts a null value in this scenario.

• As part of 436patches25696, when you use a stored procedure in the Oracle - Execute Snap, the Snap now displays Message: Success and $UPDATE_COUNT=-1, 0, or 1 (specific to the Snap Pack) in the output.

Fixed Issues

• Anaplan: (436patches25571)

  • Removed case sensitivity on values for the Action name field in the Anaplan Action Snap.

  • Removed case sensitivity on values for the Workspace and Model fields for all the Anaplan Snaps.

• Copybook: (main171)

  • Fixed a null pointer error in all the Copybook Snaps.

  • Fixed an issue in structure options in the COBOL Copybook Parser Snap.

• Fixed an issue with the Google Directory Read Snap that displayed a null pointer exception when the Filter attributes field set was configured with key-value entries. (436patches25581)

• Fixed a memory management issue in the HDFS Writer, HDFS ZipFile Writer, ORC Writer, and Parquet Writer Snaps, which previously caused out-of-memory errors when multiple Snaps were used in the pipeline. The Snap now conducts a pre-allocation memory check, dynamically adjusting the write buffer size based on available memory resources when writing to ADLS. (436patches25902)

• Fixed an issue with the JSON Formatter Snap that generated incorrect schema. (436patches25564)

• MySQL: (436patches25659)

  • Fixed an issue with the MySQL - Multi Execute Snap that committed the changes when the Snap was expected to roll back if any query failed and the Number of Retries was more than 0. The Snap now performs a rollback when one or more queries fail.

  • Fixed an issue with the MySQL - Insert Snap that displayed an error when you inserted values such as 128 or more in the Tinyint unsigned datatype when the datatype must accept all the values in the range of 0-255.

  • Fixed an issue with the MySQL - Insert  Snap that failed to store the Time datatype with precision in the target table when passed from an upstream Mapper Snap in string or Date-only format.

• Fixed an issue with the NetSuite Upsert Snap that displayed a null pointer exception when the account had insufficient permissions. Now the Snap displays a configuration exception when the customFieldRecord is null. (436patches25801)

• Oracle: (436patches25696)

  • Fixed an issue with the Oracle - Bulk Load Snap to handle the type definition of nvarchar and nchar data types by defining them in the control file of the SQL loader.

  • Fixed an issue with the Oracle - Bulk Load Snap that incorrectly incremented the year part of the DATE datatype for specific datasets.

  • Fixed an issue with the Oracle - Merge Snap that did not handle the timestamp conversion correctly when the time was not in the hh:mm format and had single digits (for example, 1:9) in the timestamp.

  • The Oracle - Execute Snap displays both the status and the message in the output when you call stored procedures.

• Fixed an issue with the Pipeline Execute Snap where output documents were not being read. (436patches25576)

• SQL Server:

  • Fixed an issue with the SQL Server - Insert Snap that previously displayed an error when attempting to insert a true or false value into a TinyInt datatype. The Snap now correctly inserts 1 or 0 for true or false in the table, respectively. (436patches25757)

  • Fixed an issue with the SQL Server - Insert Snap that displayed an error when an empty or blank string was passed as a value to an integer-type column. (436patches25548)

SnapGPT

Enhancements

• The expression-enabled fields in Snap dialogs display a placeholder text, Explain your expression and click SnapGPT icon, which prompts user input. SnapGPT then suggests expressions to match your use case.