Highlights

The SnapLogic® November 2023 Release includes the following:

Admin Manager

• Manage allowlists for Groundplexes with an easy-to-use interface

• Configure pipeline validation and the number of documents displayed in Snap data previews

API Management

• View the API catalog and documentation without logging in to the Developer Portal

• Introduced new API policies:

  • JWT Validator Policy authenticates users with a token

  • TLS Outbound Policy supports using certificates for client and server communication

AutoSync

• New destination endpoints: on-premises Oracle and on-premises SQL Server

• New source endpoint: Google Analytics 4

• Synchronize a subset of table data

Platform

• Cloudplex Secure Connectivity with AWS Private Link enables Cloudplexes to communicate with AWS and on-premises data sources

Snaps

• Introduced the NetSuite REST Snap Pack:

  • NetSuite REST Read

  • NetSuite REST Execute

  • NetSuite REST Search

  • NetSuite REST Access Token Account

  • NetSuite REST M2M OAuth2 Account

• Added the Google Service Account to the HTTP Client Snap

SnapGPT

• Improved support for generating SQL queries with a new SQL editor preview panel in the Designer

Dot Releases - Platform

Date	Feature	Description

Date	Feature	Description
Nov 21, 2023	Snaplex version: main-21368 - 4.35 Patch 1 (Recommended)	Fixed an issue where using expressions to reference accounts did not work.
Nov 10, 2023	Admin Manager	The Groundplex allowlist tab contains updated text. Previously, two labels incorrectly referred to Tasks. The screenshot below this table shows the corrected labels. Open
	Git Integration	Fixed an issue where users received a 500 status authenticating with Git even though the App Gateway was correctly configured.

Dot Releases - Snaps

Upgrading to this Release

Admin Manager

Features

• Introduced a user-friendly interface, which helps admins manage a Groundplex IP address allowlist:
  
  

  Open

  

   

• Control pipeline validation in the environment from the new Pipeline validation screen. With validation enabled, Environment admins can set the maximum number of documents that Snaps display in the data preview. With validation disabled, data preview is not available.
  
  

Enhancements

• Input values directly as an alternative to using the sliders on the Session timeout and the Password expiration screen:
  
  

   

• The dialog for creating a new service account now provides a radio button for selecting a role. Learn more about roles.
  
  

   

• The New user screen now includes a toggle for password-based authentication. Learn more.
  
  

Fixed Issues

• Delete a group from the table on the Groups screen. Hover on the right side of a row to display the Delete link:
  
  

• Change a user’s role by editing their account.

API Management

Features

• View the API catalog and API documentation without logging in to the Developer Portal by enabling the Allow access without login checkbox under the Settings tab in the Portal Manager.
  
  

   

• The JWT Validator API policy authenticates a request with a Java Web Token (JWT). When this policy is applied, API consumers must use their credentials to sign their JWT. If the token is invalid, the request is not processed.
  
  

   

• The Outbound TLS API policy ensures that outbound endpoints are verified by TLS certificates during API processing. When a client calls a Proxy API with this policy, the server and client exchange certificates.
  
  

Enhancements

• Org admins can now grant users full access to publish, unpublish, deprecate, and retire Proxies and APIs by enabling the Allow Full-Access users to publish checkbox in Portal Manager > Settings page.
  
  

Fixed Issues

• Fixed an issue where the API Dashboard displayed incorrect data because a Snaplex node pushed the same data multiple times to the control plane.

AutoSync

Features

• New destination endpoints:

  • On-premises Oracle

  • On-premises SQL Server

• New source endpoint: Google Analytics 4

• The option to synchronize a subset of table columns or object fields provides the following benefits:

  • Save costs by storing only necessary data

  • Filter out data that is unrelated to the business objective

  • Exclude sensitive data

Enhancements

• Data pipelines with Google BigQuery as a source can now use Incremental or SCD2 as a load type.

Fixed Issues

• For the SFTP endpoint, Binary Two-factor Auth Accounts created in the IIP now work correctly.

• You can now select a Groundplex for on-premises targets when creating a data pipeline. This Groundplex connects to the on-premises data sources and on-premises destinations in the integration, so it needs to have access to both source and destination subnets/network ranges.

• Special characters in user names no longer cause an issue with Accounts created in the IIP.

Known Issues

• For integrations that load from Google BigQuery to BigQuery, failures can occur if a source BIGNUMERIC column does not have precision and scale set and contains a value with precision larger than 76. This happens because when the precision and scale for a BIGNUMERIC column is not set in the source, AutoSync sets it to (76,38) when creating the target table. BigQuery can actually store a BIGNUMERIC value with a precision and scale of (76.76,38).
  Workaround: Set the precision and scale for BIGNUMERIC columns in the source to (76,38).

• For integrations with Google BigQuery as a source or destination, the Filter columns data preview might not contain data, so there is no way to select the columns that you do not want to synchronize.
  Workaround: The issue is intermittent. Try re-creating the data pipeline.

• Clarification to documented behavior: When using the Append load type for CSV files, if you upload a file containing content that was previously uploaded, the content is duplicated in the destination. This is because CSV files do not have primary keys to distinguish the data.

• For efficiency and performance, AutoSync uses bulk load for Salesforce objects. The Salesforce Bulk API does not support all object types. Refer to the Salesforce discussion forum for more information.

Data Automation

Enhancements

• Enhanced the ELT Merge Into and ELT SCD2 Snaps to display detailed pipeline execution statistics about the data loaded to target tables on a Databricks Lakehouse Platform instance. In addition to the individual counts of rows inserted, updated, and deleted that the ELT Merge Into Snap covers, the ELT SCD2 Snap also reports the count of source rows rejected.

Platform

Features

• Cloudplex Secure Connectivity with AWS Private Link enables Cloudplexes to communicate with AWS and on-premises data sources. The New connection wizard simplifies the configuration process, and the Cloudplex Secure Connectivity screen provides an easy way to monitor connections and their statuses. You can create up to 3 connections for each of your Cloudplexes. This beta feature provides a way to take advantage of Snaplexes managed by SnapLogic to run your pipelines to endpoints in the public cloud. Your Environment must have this subscription enabled.
  
  

Enhancements

• When an Org admin changes a user’s access to the IIP or to AutoSync, the user now receives a notification email.

• Org admins can now audit changes to the IP, CORS, and the Groundplex Allowlists through events in the Activity Log.

• Org admins can monitor any requested changes to the API Daily Limit and Concurrent API Limit through events recorded in the Activity Log.

• Memory-optimized nodes are now available for Cloudplexes.

• Asia Pacific (Mumbai) is now supported as a Cloudplex region. The AWS API name is ap-south-1. Learn more about https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/1449033775.

Fixed Issues

When using the Git integration, sometimes Tasks were showing as locally modified when no changes were made.

Behavior Changes

• Increased control over whether pipeline designers can view real data in Snap data previews. Data previews populate during pipeline validation. Previously, Org admins could disable pipeline validation for the Org, but individual users could override that in their User Settings. Now in Admin Manager:

  • If an Environment admin (formerly Org admin) disables pipeline validation, users cannot override the setting and enable data preview.

  • If pipeline validation is enabled, an Environment admin can limit the number of documents shown in data previews. Users can customize their personal User Setting up to the maximum number selected by the Environment admin. Learn more.

Snaps

Behavior Changes

New Snaps and Accounts

• Introduced the NetSuite REST Snap Pack, which contains the following Snaps and Accounts:

  • NetSuite REST Access Token Account: Connects NetSuite REST Snaps with the NetSuite SuiteCloud Rest services that rely on the bearer token.

  • NetSuite REST M2M OAuth2 Account: Authenticates with NetSuite’s REST APIs using the NetSuite M2M client credentials OAuth2 protocol.

  • NetSuite REST Read: Reads records based on the Record ID.

  • NetSuite REST SuiteQL: Executes SuiteQL queries on the NetSuite server.

  • NetSuite REST Search: Fetches data from the NetSuite server based on the specified search criteria.

• Added the Google Service Account to the HTTP Client Snap, which enables you to connect to various Google Cloud endpoints such as Analytics 4 and Compute Engine.

Enhancements

• Enhanced the Anaplan Snap Pack with support for retries to help avoid failures during the pipeline execution.

• The Copybook Parser Snap now supports configuring fields from subsequent copybooks using fully qualified names.

• The existing NetSuite Snap Pack is renamed to NetSuite SOAP due to the introduction of the NetSuite REST Snap Pack.

• The JSON key field in the Binary Google Service Account supports JSON strings. You can set the JSON key with a file from SLDB. You can also dynamically pass the value with a pipeline parameter or a secrets manager expression.

• Hadoop Snap Pack:

  • Enhanced the Parquet Reader Snap with a new Use datetime types checkbox, which supports LocalDate and DateTime datatypes.

  • Enhanced the Parquet Writer Snap with the support for LocalDate and DateTime. The Snap now shows the schema suggestions for LocalDate and DateTime correctly.

  • Enhanced the Parquet Writer Snap with a Decimal Rounding Mode dropdown list to enable the rounding method for decimal values when the number exceeds the required decimal places.

• Added pagination in the List Read Items Snap. Also added suggestions for the List name field.

• Microsoft Dynamics 365 Finance and SCM and Microsoft Dynamics 365 Business Central Snap Packs:

  • Enhanced the following Snaps with a new Error out on no results checkbox, which selectively routes the input document to the error view when no results are returned:

    • Dynamics 365 Finance and SCM Read and Dynamics 365 Finance and SCM Search

    • Dynamics 365 Business Central Read and Dynamics 365 Business Central Search

  • Added proxy authentication.

  • The Instance URL field in the Microsoft Dynamics 365 Finance and SCM Access Token Account and the Business Central Access Token Account is no longer expression enabled by default.

  • The Cross company checkbox is added to the Dynamics 365 Finance and SCM Create, Update, and Delete Snaps to ensure that the other company records are getting created, updated, and deleted.

• Improved the Salesforce Bulk Upsert Snap error messages by limiting the length of the reason displayed with the error. (Within the error reported to the UI, the full message is logged.)

• The SAP Concur OAuth2 Account now supports the Auth endpoint config and Token endpoint config field sets to configure custom properties for the OAuth2 endpoint.

• Enhanced the input schema for the SAP S/4HANA Create Snap.

• The Snowflake Snap Pack is now bundled with the default Snowflake JDBC JAR v3.14.0.

• The Splunk Basic Auth Account now includes Read timeout and Connection timeout fields, which enable you to manage the timeout settings for your connections.

• Improved the SQL Server Bulk Load Snap by adding automated retries to help avoid failures during the pipeline execution.

• The SharePoint Online - Upload File Snap now supports files larger than 2 GB.

SnapGPT

• Improved support for generating SQL queries with a new SQL editor preview panel in the Designer.

• Improved overall quality of generated results for all features:

  • Pipeline description

  • Pipeline generation

  • Expression generation and mappings for the Mapper Snap

  • SQL query generation

  • Q&A using the SnapLogic documentation knowledge base

Documentation Enhancements

New Video

• Configure Snowflake S3 Dynamic Account - Watch this video to understand what steps you need to take to configure this account.

Enhancements

• Introduced the Groundplex migration document.

• Added a new configuration page for Snowflake S3 Dynamic Account and a corresponding video for better readability and usability.

• We have migrated the documentation for the Analytics Snaps to our new documentation site.

• The following documents are no longer available in the Confluence documentation site:

  • Snap Settings Dialog

  • Connecting Snaps

  • Configuration Settings for Snaps

  • Apache Templates in Snaps

  • Provided Platform Libraries

  • SnapLogic Glossary