November 2023 Release Notes
Highlights
The SnapLogic® November 2023 Release includes the following:
Manage allowlists for Groundplexes with an easy-to-use interface
Configure pipeline validation and the number of documents displayed in Snap data previews
View the API catalog and documentation without logging in to the Developer Portal
Introduced new API policies:
JWT Validator Policy authenticates users with a token
TLS Outbound Policy supports using certificates for client and server communication
New destination endpoints: on-premises Oracle and on-premises SQL Server
New source endpoint: Google Analytics 4
Synchronize a subset of table data
Cloudplex Secure Connectivity with AWS Private Link enables Cloudplexes to communicate with AWS and on-premises data sources
Introduced the NetSuite REST Snap Pack:
NetSuite REST Read
NetSuite REST Execute
NetSuite REST Search
NetSuite REST Access Token Account
NetSuite REST M2M OAuth2 Account
Added the Google Service Account to the HTTP Client Snap
The JDBC driver for the Oracle Snap Pack is upgraded from OJDBC6 JAR (v11.2.0.4) to OJDBC10 JAR (v19.20.0.0) in the stable distribution in the November 2023 release (after the Snaplex upgrade). This upgrade changes specific error codes and status messages. The latest JDBC driver upgrade is backward-compatible. Learn more about upgrading from Oracle JDBC 11.2.0.4 driver to 19.20.0.0 driver.
Improved support for generating SQL queries with a new SQL editor preview panel in the Designer
Dot Releases - Platform
Date | Feature | Description |
---|---|---|
Nov 21, 2023 | Snaplex version: | Fixed an issue where using expressions to reference accounts did not work. |
Nov 10, 2023
| Admin Manager | The Groundplex allowlist tab contains updated text. Previously, two labels incorrectly referred to Tasks. The screenshot below this table shows the corrected labels. |
Git Integration | Fixed an issue where users received a 500 status authenticating with Git even though the App Gateway was correctly configured. |
Dot Releases - Snaps
Snap Pack | Date of Update | Snap Pack Version | Updates |
---|---|---|---|
Dec 13, 2023 | 435patches24256 |
| |
Dec 11, 2023 | 435patches24208 | Fixed an issue with the HTTP Client Snap that caused incorrect parsing of the | |
Dec 8, 2023 | 435patches24006 | Enhanced the Salesforce Read Snap by adding expression enablement to the following checkboxes:
| |
Dec 4, 2023 | 435patches24068 |
| |
Dec 4, 2023 | 435patches24094 | Fixed a deserialization issue for a unique function in the Aggregate Snap. | |
Nov 30, 2023 | 435patches24034 |
| |
Nov 21, 2023 | 435patches23943 | Fixed an issue with the GraphQL Client Snap that displayed a null pointer exception when the Header authenticated checkbox in the OAuth2 Account is deselected. The Snap now passes the credentials appropriately using URL parameters when the Header authenticated field is deselected. | |
Nov 20, 2023 | main156 | Added the HubSpot Private App Account to the HubSpot Snap Pack. | |
Nov 20, 2023 | 435patches23823 |
| |
Nov 20, 2023 | 435patches23904 |
| |
Nov 16, 2023 | 435patches23831 | Fixed an issue with the PostgreSQL-Execute and PostgreSQL-Select Snaps that added escape characters ('\\') in the output for JSONB datatype. | |
Nov 15, 2023 | 435patches23780 | Fixed an issue related to error routing to the output view. Also fixed a connection timeout issue. | |
Nov 13, 2023 | 435patches23780 | Fixed an issue with the Binary Snaps that failed to build a data connection when connecting to the FTP server over FTPS protocol. | |
Data Automation | |||
Nov 8, 2023 | 435patches23671 |
|
Upgrading to this Release
To use the new SnapLogic features and Snaps in the current GA release, ensure that your Snaplex nodes are upgraded to the recommended version.
This release includes stable versions of the monthly Snap patches deployed to the SnapLogic Platform after the August 2023 release, as listed in the Dot Releases section of the September and October Release Notes.
Per the SnapLogic Release calendar, all remaining Snaplexes across Orgs will be upgraded to the recommended version (
main-21799 - 4.35 Patch 3
) during the automatic upgrade, scheduled for 3 PM (Pacific Standard Time) on Saturday, Jan 13, 2024. Orgs that were migrated to the current GA release before the automatic upgrade are not impacted. For information on how to upgrade your Snaplex, refer to the SnapLogic Release Process.The SnapLogic GA release build that is on the production server is also deployed on the UAT server.
Admin Manager
Features
Introduced a user-friendly interface, which helps admins manage a Groundplex IP address allowlist:
Â
Control pipeline validation in the environment from the new Pipeline validation screen. With validation enabled, Environment admins can set the maximum number of documents that Snaps display in the data preview. With validation disabled, data preview is not available.
Enhancements
Input values directly as an alternative to using the sliders on the Session timeout and the Password expiration screen:
Â
The dialog for creating a new service account now provides a radio button for selecting a role. Learn more about roles.
Â
The New user screen now includes a toggle for password-based authentication. Learn more.
Fixed Issues
Delete a group from the table on the Groups screen. Hover on the right side of a row to display the Delete link:
Change a user’s role by editing their account.
API Management
Features
View the API catalog and API documentation without logging in to the Developer Portal by enabling the Allow access without login checkbox under the Settings tab in the Portal Manager.
Â
The JWT Validator API policy authenticates a request with a Java Web Token (JWT). When this policy is applied, API consumers must use their credentials to sign their JWT. If the token is invalid, the request is not processed.
Â
The Outbound TLS API policy ensures that outbound endpoints are verified by TLS certificates during API processing. When a client calls a Proxy API with this policy, the server and client exchange certificates.
Enhancements
Org admins can now grant users full access to publish, unpublish, deprecate, and retire Proxies and APIs by enabling the Allow Full-Access users to publish checkbox in Portal Manager > Settings page.
Fixed Issues
Fixed an issue where the API Dashboard displayed incorrect data because a Snaplex node pushed the same data multiple times to the control plane.
AutoSync
Features
New destination endpoints:
New source endpoint: Google Analytics 4
The option to synchronize a subset of table columns or object fields provides the following benefits:
Save costs by storing only necessary data
Filter out data that is unrelated to the business objective
Exclude sensitive data
The data pipeline wizard Filter columns screen previews up to four rows of data from each selected table. Click a column to remove it from the integration. In this release, you can only filter columns when creating data pipelines, not when editing them. Learn more.
Enhancements
Data pipelines with Google BigQuery as a source can now use Incremental or SCD2 as a load type.
Fixed Issues
For the SFTP endpoint, Binary Two-factor Auth Accounts created in the IIP now work correctly.
You can now select a Groundplex for on-premises targets when creating a data pipeline. This Groundplex connects to the on-premises data sources and on-premises destinations in the integration, so it needs to have access to both source and destination subnets/network ranges.
Special characters in user names no longer cause an issue with Accounts created in the IIP.
Known Issues
For integrations that load from Google BigQuery to BigQuery, failures can occur if a source
BIGNUMERIC
column does not have precision and scale set and contains a value with precision larger than76
. This happens because when the precision and scale for aBIGNUMERIC
column is not set in the source, AutoSync sets it to (76,38
) when creating the target table. BigQuery can actually store aBIGNUMERIC
value with a precision and scale of (76.76,38
).
Workaround: Set the precision and scale for BIGNUMERIC columns in the source to (76,38
).For integrations with Google BigQuery as a source or destination, the Filter columns data preview might not contain data, so there is no way to select the columns that you do not want to synchronize.
Workaround: The issue is intermittent. Try re-creating the data pipeline.Clarification to documented behavior: When using the Append load type for CSV files, if you upload a file containing content that was previously uploaded, the content is duplicated in the destination. This is because CSV files do not have primary keys to distinguish the data.
For efficiency and performance, AutoSync uses bulk load for Salesforce objects. The Salesforce Bulk API does not support all object types. Refer to the Salesforce discussion forum for more information.
Data Automation
Enhancements
Enhanced the ELT Merge Into and ELT SCD2 Snaps to display detailed pipeline execution statistics about the data loaded to target tables on a Databricks Lakehouse Platform instance. In addition to the individual counts of rows inserted, updated, and deleted that the ELT Merge Into Snap covers, the ELT SCD2 Snap also reports the count of source rows rejected.
Platform
The Dashboard Lineage tab is discontinued in the November 2023 release.
Features
Cloudplex Secure Connectivity with AWS Private Link enables Cloudplexes to communicate with AWS and on-premises data sources. The New connection wizard simplifies the configuration process, and the Cloudplex Secure Connectivity screen provides an easy way to monitor connections and their statuses. You can create up to 3 connections for each of your Cloudplexes. This beta feature provides a way to take advantage of Snaplexes managed by SnapLogic to run your pipelines to endpoints in the public cloud. Your Environment must have this subscription enabled.
Enhancements
When an Org admin changes a user’s access to the IIP or to AutoSync, the user now receives a notification email.
Org admins can now audit changes to the IP, CORS, and the Groundplex Allowlists through events in the Activity Log.
Org admins can monitor any requested changes to the API Daily Limit and Concurrent API Limit through events recorded in the Activity Log.
Memory-optimized nodes are now available for Cloudplexes.
Asia Pacific (Mumbai) is now supported as a Cloudplex region. The AWS API name is
ap-south-1
. Learn more about Adding the SnapLogic Platform to your Allowlist.
Fixed Issues
When using the Git integration, sometimes Tasks were showing as locally modified when no changes were made.
Behavior Changes
Increased control over whether pipeline designers can view real data in Snap data previews. Data previews populate during pipeline validation. Previously, Org admins could disable pipeline validation for the Org, but individual users could override that in their User Settings. Now in Admin Manager:
If an Environment admin (formerly Org admin) disables pipeline validation, users cannot override the setting and enable data preview.
If pipeline validation is enabled, an Environment admin can limit the number of documents shown in data previews. Users can customize their personal User Setting up to the maximum number selected by the Environment admin. Learn more.
Snaps
Behavior Changes
New Snaps and Accounts
Introduced the NetSuite REST Snap Pack, which contains the following Snaps and Accounts:
NetSuite REST Access Token Account: Connects NetSuite REST Snaps with the NetSuite SuiteCloud Rest services that rely on the bearer token.
NetSuite REST M2M OAuth2 Account: Authenticates with NetSuite’s REST APIs using the NetSuite M2M client credentials OAuth2 protocol.
NetSuite REST Read: Reads records based on the Record ID.
NetSuite REST SuiteQL: Executes SuiteQL queries on the NetSuite server.
NetSuite REST Search: Fetches data from the NetSuite server based on the specified search criteria.
Added the Google Service Account to the HTTP Client Snap, which enables you to connect to various Google Cloud endpoints such as Analytics 4 and Compute Engine.
Updated the Google Spreadsheet Snap Pack and Snap names to Google Sheets.
Enhancements
Enhanced the Anaplan Snap Pack with support for retries to help avoid failures during the pipeline execution.
The Copybook Parser Snap now supports configuring fields from subsequent copybooks using fully qualified names.
The existing NetSuite Snap Pack is renamed to NetSuite SOAP due to the introduction of the NetSuite REST Snap Pack.
The JSON key field in the Binary Google Service Account supports JSON strings. You can set the JSON key with a file from SLDB. You can also dynamically pass the value with a pipeline parameter or a secrets manager expression.
Enhanced the Parquet Reader Snap with a new Use datetime types checkbox, which supports LocalDate and DateTime datatypes.
Enhanced the Parquet Writer Snap with the support for LocalDate and DateTime. The Snap now shows the schema suggestions for LocalDate and DateTime correctly.
Enhanced the Parquet Writer Snap with a Decimal Rounding Mode dropdown list to enable the rounding method for decimal values when the number exceeds the required decimal places.
Added pagination in the List Read Items Snap. Also added suggestions for the List name field.
Microsoft Dynamics 365 Finance and SCM and Microsoft Dynamics 365 Business Central Snap Packs:
Enhanced the following Snaps with a new Error out on no results checkbox, which selectively routes the input document to the error view when no results are returned:
Added proxy authentication.
The Instance URL field in the Microsoft Dynamics 365 Finance and SCM Access Token Account and the Business Central Access Token Account is no longer expression enabled by default.
The Cross company checkbox is added to the Dynamics 365 Finance and SCM Create, Update, and Delete Snaps to ensure that the other company records are getting created, updated, and deleted.
Improved the Salesforce Bulk Upsert Snap error messages by limiting the length of the reason displayed with the error. (Within the error reported to the UI, the full message is logged.)
The SAP Concur OAuth2 Account now supports the Auth endpoint config and Token endpoint config field sets to configure custom properties for the OAuth2 endpoint.
Enhanced the input schema for the SAP S/4HANA Create Snap.
The Snowflake Snap Pack is now bundled with the default Snowflake JDBC JAR v3.14.0.
The Splunk Basic Auth Account now includes Read timeout and Connection timeout fields, which enable you to manage the timeout settings for your connections.
Improved the SQL Server Bulk Load Snap by adding automated retries to help avoid failures during the pipeline execution.
The SharePoint Online - Upload File Snap now supports files larger than 2 GB.
SnapGPT
Improved support for generating SQL queries with a new SQL editor preview panel in the Designer.
Improved overall quality of generated results for all features:
Pipeline description
Pipeline generation
Expression generation and mappings for the Mapper Snap
SQL query generation
Q&A using the SnapLogic documentation knowledge base
Documentation Enhancements
New Video
Configure Snowflake S3 Dynamic Account - Watch this video to understand what steps you need to take to configure this account.
Enhancements
Introduced the Groundplex migration document.
Added a new configuration page for Snowflake S3 Dynamic Account and a corresponding video for better readability and usability.
We have migrated the documentation for the Analytics Snaps to our new documentation site.
The following documents are no longer available in the Confluence documentation site:
Have feedback? Email documentation@snaplogic.com | Ask a question in the SnapLogic Community
© 2017-2024 SnapLogic, Inc.