Added the Google Service Account to the HTTP Client Snap
The JDBC driver for the Oracle Snap Pack is upgraded from OJDBC6 JAR (v18.104.22.168) to OJDBC10 JAR (v22.214.171.124) in the stable distribution in the November 2023 release (after the Snaplex upgrade). This upgrade changes specific error codes and status messages. The latest JDBC driver upgrade is backward-compatible. Learn more about upgrading from Oracle JDBC 126.96.36.199 driver to 188.8.131.52 driver.
Enhanced the SAP IDoc Listener and SAP IDoc Document Listener Snaps with a new Halt on SAP error checkbox for better error-handling capability. Select this checkbox to enable the listener to interrupt and halt processing in case of an error from SAP.
Removed the unnecessary spring-core dependency from the SAP Snap Pack.
Fixed an issue with the GraphQL Client Snap that displayed a null pointer exception when the Header authenticated checkbox in the OAuth2 Account is deselected. The Snap now passes the credentials appropriately using URL parameters when the Header authenticated field is deselected.
With Databricks Lakehouse Platform as the target CDW, you can now define your update expressions with the WHEN NOT MATCHED BY SOURCE clause besides other supported clauses and expression lists in the ELT Merge Into Snap.
Upgrading to this Release
To use the new SnapLogic features and Snaps in the current GA release, ensure that your Snaplex nodes are upgraded to the recommended version.
This release includes stable versions of the monthly Snap patches deployed to the SnapLogic Platform after the August 2023 release, as listed in the Dot Releases section of the September and October Release Notes.
Per the SnapLogic Release calendar, all remaining Snaplexes across Orgs will be upgraded to the recommended version (main-21052 - 4.35 GA) during the automatic upgrade, scheduled for 3 PM (Pacific Standard Time) on Saturday, Jan 6, 2024. Orgs that were migrated to the current GA release before the automatic upgrade are not impacted. For information on how to upgrade your Snaplex, refer to the SnapLogic Release Process.
The SnapLogic GA release build that is on the production server is also deployed on the UAT server.
Control pipeline validation in the environment from the new Pipeline validation screen. With validation enabled, Environment admins can set the maximum number of documents that Snaps display in the data preview. With validation disabled, data preview is not available.
Input values directly as an alternative to using the sliders on the Session timeout and the Password expiration screen:
The dialog for creating a new service account now provides a radio button for selecting a role. Learn more about roles.
The New user screen now includes a toggle for password-based authentication. Learn more.
Delete a group from the table on the Groups screen. Hover on the right side of a row to display the Delete link:
Change a user’s role by editing their account.
View the API catalog and API documentation without logging in to the Developer Portal by enabling the Allow access without login checkbox under the Settings tab in the Portal Manager.
The JWT Validator API policy authenticates a request with a Java Web Token (JWT). When this policy is applied, API consumers must use their credentials to sign their JWT. If the token is invalid, the request is not processed.
The Outbound TLS API policy ensures that outbound endpoints are verified by TLS certificates during API processing. When a client calls a Proxy API with this policy, the server and client exchange certificates.
Org admins can now grant users full access to publish, unpublish, deprecate, and retire Proxies and APIs by enabling the Allow Full-Access users to publish checkboxin Portal Manager > Settings page.
Fixed an issue where the API Dashboard displayed incorrect data because a Snaplex node pushed the same data multiple times to the control plane.
The option to synchronize a subset of table columns or object fields provides the following benefits:
Save costs by storing only necessary data
Filter out data that is unrelated to the business objective
Exclude sensitive data
The data pipeline wizard Filter columns screen previews up to four rows of data from each selected table. Click a column to remove it from the integration. In this release, you can only filter columns when creating data pipelines, not when editing them. Learn more.
Data pipelines with Google BigQuery as a source can now use Incremental or SCD2 as a load type.
You can now select a Groundplex for on-premises targets when creating a data pipeline. This Groundplex connects to the on-premises data sources and on-premises destinations in the integration, so it needs to have access to both source and destination subnets/network ranges.
Special characters in user names no longer cause an issue with Accounts created in the IIP.
For integrations that load from Google BigQuery to BigQuery, failures can occur if a source BIGNUMERIC column does not have precision and scale set and contains a value with precision larger than 76. This happens because when the precision and scale for a BIGNUMERIC column is not set in the source, AutoSync sets it to (76,38) when creating the target table. BigQuery can actually store a BIGNUMERIC value with a precision and scale of (76.76,38). Workaround: Set the precision and scale for BIGNUMERIC columns in the source to (76,38).
For integrations with Google BigQuery as a source or destination, the Filter columns data preview might not contain data, so there is no way to select the columns that you do not want to synchronize. Workaround: The issue is intermittent. Try re-creating the data pipeline.
Clarification to documented behavior: When using the Append load type for CSV files, if you upload a file containing content that was previously uploaded, the content is duplicated in the destination. This is because CSV files do not have primary keys to distinguish the data.
For efficiency and performance, AutoSync uses bulk load for Salesforce objects. The Salesforce Bulk API does not support all object types. Refer to the Salesforce discussion forum for more information.
Enhanced the ELT Merge Into and ELT SCD2 Snaps to display detailed pipeline execution statistics about the data loaded to target tables on a Databricks Lakehouse Platform instance. In addition to the individual counts of rows inserted, updated, and deleted that the ELT Merge Into Snap covers, the ELT SCD2 Snap also reports the count of source rows rejected.
The Dashboard Lineage tab is discontinued in the November 2023 release.
Cloudplex Secure Connectivity with AWS Private Link enables Cloudplexes to communicate with AWS and on-premises data sources. The New connection wizard simplifies the configuration process, and the Cloudplex Secure Connectivity screen provides an easy way to monitor connections and their statuses. You can create up to 3 connections for each of your Cloudplexes. This beta feature provides a way to take advantage of Snaplexes managed by SnapLogic to run your pipelines to endpoints in the public cloud. Your Environment must have this subscription enabled.
When an Org admin changes a user’s access to the IIP or to AutoSync, the user now receives a notification email.
Org admins can now audit changes to the IP, CORS, and the Groundplex Allowlists through events in the Activity Log.
Org admins can monitor any requested changes to the API Daily Limit and Concurrent API Limit through events recorded in the Activity Log.
Memory-optimized nodes are now available for Cloudplexes.
When using the Git integration, sometimes Tasks were showing as locally modified when no changes were made.
Increased control over whether pipeline designers can view real data in Snap data previews. Data previews populate during pipeline validation. Previously, Org admins could disable pipeline validation for the Org, but individual users could override that in their User Settings. Now in Admin Manager:
If an Environment admin (formerly Org admin) disables pipeline validation, users cannot override the setting and enable data preview.
If pipeline validation is enabled, an Environment admin can limit the number of documents shown in data previews. Users can customize their personal User Setting up to the maximum number selected by the Environment admin. Learn more.
The JDBC driver for the Oracle Snap Pack is upgraded from OJDBC6 JAR (v184.108.40.206) to OJDBC10 JAR (v220.127.116.11) in the stable distribution in the November 2023 release (after the Snaplex upgrade). This upgrade changes specific error codes and status messages. The latest JDBC driver upgrade is backward-compatible. Learn more about upgrading from Oracle JDBC 18.104.22.168 Driver to 22.214.171.124 Driver.
As of November 1, 2023, Snowflake instances hosted on Google Cloud must use Snowflake JDBC JARs v3.13.25 or higher. If you are using the default drivers bundled with Snowflake or ELT Snaps, your pipelines are not affected. If your Snowflake instances hosted on Google Cloud use older JARs, you must update the client drivers. Learn more.
When you select the Use datetime types checkbox in the Parquet Reader Snap, the Snap displays the LocalDate and DateTime in the output for INT32 (DATE) and INT64 (TIMESTAMP_MILLIS) columns. When you deselect this checkbox, the columns retain the previous datatypes and display string and integer values in the output.
The JSON key field in the Binary Google Service Account supports JSON strings. You can set the JSON key with a file from SLDB. You can also dynamically pass the value with a pipeline parameter or a secrets manager expression.