Highlights
The SnapLogic® October 2023 Release includes the following:
Added the ability to manage password expiration, session timeout, and SSO configuration
Added the ability to manage Snaplex versions and add a Snaplex (Groundplex)
Added support for OpenID Connect
The Developer Portal can now be launched from the Resources section of the Apps menu
Introduced multiple sources for one data pipeline
Added support for new endpoints: MySQL and SFTP (source), SAP HANA (target)
Added support for New Relic observability tools through OpenTelemetry implementation
The JCC now has the additional capability to upload large log files to S3 directly, provided it has the required access.
Introduced the following Snaps in the Google Analytics 4 Snap Pack:
Get Metadata
List Accounts
List Properties
Introduced the Teamcenter Snap Pack
Improved support for generating expressions in the Mapper Snap with a new review panel in the UI
Added support for answering questions using the SnapLogic documentation knowledge base
Dot Releases - Snaps
Snap Pack | Date of Update | Snap Pack Version | Updates |
---|---|---|---|
| 434patches23646 | Fixed an issue where a long-running pipeline containing the Salesforce Subscriber Snap would suddenly stop responding. | |
| 434patches23541 | Fixed an issue with the Snowflake-Bulk Load Snap that was writing extra errors to the error view when both the inserted data was not in the same order as the table schema and the Staging location was Internal. The Snap now writes the actual errors to the error view. | |
| 434patches23422 | The Splunk Basic Auth Account now includes Read timeout and Connection timeout fields, that enable you to manage the timeout settings for your connections. | |
| main150 | Fixed an issue with the OAuth 2.0 account that was causing it to reload. | |
| main150 | Added pagination in the List Read Items Snap. Also added suggestions for the List name field. | |
| main150 | Enhanced the input schema for the SAP S/4HANA Create Snap. | |
| main150 | The SAP Concur Snap Pack now supports v1.0, v1.1, v4.0, and v4.1 API versions. Learn more about the API versions: https://developer.concur.com/api-explorer/ | |
| 434patches23363 | Fixed the behavior change introduced in 4.32 GA related to Amazon SQS Accounts using the STS token. After the 4.32 GA, the account would automatically retry authentication on encountering 401 or 403 errors, and pipelines would not fail even after token expiration. The Amazon SQS Consumer Snap now behaves as expected and fails after the STS token expires. | |
434patches23302 | Fixed an issue that occurred when node properties were used to override default algorithm specifications for SFTP operations. |
Admin Manager
Features
Create a Groundplex configuration and manage Snaplex Versions in the new streamlined interface. All Snaplexes associated with the Environment display on the Snaplexes screen:
Manage login security in Admin Manager by configuring:
Session and idle timeouts:
Password expiration and notices:
Single Sign On (SSO):
Learn more about login security.
Known Issues
You cannot delete a group from the Groups screen.
Workaround: Delete the group from the IIP Manager.When you try to change a user’s role by editing their user account directly, the change is not saved.
Workaround: Instead of clicking the row for a user to open the edit screen, change their role from the list view.
API Management
Features
APIM supports OpenID Connect (OIDC). When you add the Generic OAuth 2 policy to your APIs, you can use an OIDC provider to authenticate the API request, and the Generic OAuth2 policy authorizes it:
Users with a login for the SnapLogic Platform can now open the Developer Portal with one click from the Resources section of the Apps menu:
Enhancements
Response transformation policies for API Proxies (Response Mapper and Response Transformer) now support the API expression language request and response functions, such as
request.headers
andresponse. status_code
. The dropdown list displays these options when you click in the policy dialog:When publishing an API, you can add a link to the Terms of Service and License in the Swagger Editor inside the specification, and both appear as web links in the API details on the Developer Portal:
Fixed Issues
There are issues when pushing data multiple times in the API Dashboard from the Snaplex node to the Control Plane.
Workaround: Reload the dashboard.
AutoSync
AutoSync V1.0 and the accompanying documentation has been deprecated and replaced with the new version of AutoSync. The new version provides an enhanced user experience, improved performance, and is available from the Apps menu. Contact your Customer Success Manager for a free trial of AutoSync. Learn more.
Features
AutoSync now supports the following endpoints:
SFTP as a source
On-premises MySQL as a source
SAP HANA as a target (On-premises SAP HANA can only be used in data pipelines with on-premises sources, MySQL, Oracle, or SQL Server.)
Now, you can select up to five sources for one data pipeline, with the following exceptions:
The CSV file endpoint cannot be used with other sources.
On-premises sources (Oracle, SQL Server, and MySQL) can be used in the same data pipeline, but cannot be mixed with off-premises sources.
Example overview of a data pipeline with three sources:
Enhancements
You can now select multiple tables to synchronize for Oracle and SQL Server endpoints.
Fixed Issues
Integrations with Zendesk as a source and Google BigQuery as a destination now load records correctly for the SCD2 load type.
You can now create credentials for on-premises sources in AutoSync.
Known Issues
For the SFTP endpoint, Binary Two-factor Auth Accounts created in the IIP can fail with a
File not found
error.
Workaround: Create new credentials in AutoSync Manager or edit the Account created in the IIP to include the complete path in the Private Key field instead of a file name.MySQL credentials cannot be created in AutoSync because they need an updated JDBC JAR file.
Workaround: Create the Account in the IIP and specify the correct JAR file. Learn more.Uploading or updating files in the flyout panel of an existing pipeline with CSV as a source causes an error.
Workaround: Upload files in the card view.AutoSync uses a UTC timezone to track updates for SCD2 or Incremental load to a Snowflake destination. If you create a Snowflake Account in the IIP, you must add a URI parameter with the name
TIMEZONE
and set the value toUTC
.Users whose emails include a special character other than @ (the at sign) cannot add credentials using the AutoSync Manager in the IIP.
Workaround:To share an Account with all users in the environment, create them in the IIP, from the Manager Accounts tab, and save them in the global shared folder.
To share with AutoSync users, create credentials in AutoSync and share them with an individual or a group.
Platform
The Dashboard Lineage tab will be discontinued in the November 2023 release.
The slz7 TLS certificate is scheduled to expire on November 1, 2023. Make sure you update your certificate on October 31, 2023.
The updated certificate for US http://cdn.elastic.snaplogic.com will be available on November 7, 2023.
Features
SnapLogic’s third-party Observability tools integration now extends to New Relic observability tools. You can now monitor and analyze your runtime logs in New Relic software.
Enhancements
The Activity Log has more details about Org admin actions made to Manager > Settings. For example, when an Org admin changes the values for a Session Timeout, the Activity Log records the event change:
Snaps
The Snaps mentioned in this section are deployed on the Latest distribution type. To access the updated Snap Packs, an Org admin must select the Snap Pack version in Manager > Snap Packs.
Behavior Change
The JDBC driver upgrade to OJDBC10 JAR (v19.20.0.0) resulted in specific behavior changes in error messages and status codes. Learn more about the behavior changes to ensure seamless migration to the upgraded driver.
Upcoming
Starting November 1, 2023, Snowflake instances hosted on Google Cloud must use Snowflake JDBC JARs v3.13.25 or higher. If you are using the default drivers bundled with Snowflake or ELT Snaps, your pipelines are not affected. If your Snowflake instances hosted on Google Cloud use older JARs, you must update the client drivers. Learn more.
Starting November 8, 2023, the Snowflake Snap Pack is bundled with the default Snowflake JDBC JAR v3.14.
New Snaps
Introduced the following Snaps in the Google Analytics 4 Snap Pack:
Get Metadata: Fetches all the metrics and dimensions associated with your Google service account ID and property ID
List Accounts: Fetches all the account IDs associated with your Google service account
List Properties: Fetches all the property IDs associated with your account ID
Introduced the Teamcenter Snap Pack, which includes the following comprehensive list of Snaps:
Enhancements
The Binary Upload File Snap now supports files larger than 2 GB.
The Copybook Parser Snap now supports configuring fields from subsequent copybooks using fully qualified names.
The Cross company checkbox is added to the Microsoft Dynamics 365 Finance and SCM Create, Update, and Delete Snaps to ensure the other company (other than the default company) records are created, updated, and deleted.
The JDBC driver for the Oracle Snap Pack is upgraded from OJDBC6 JAR (v11.2.0.4) to OJDBC10 JAR (v19.20.0.0) in the latest distribution in October 2023 (434patches23000) and in the stable distribution in the November 2023 release (after the Snaplex upgrade). This upgrade changes specific error codes and status messages. The latest JDBC driver upgrade is backward-compatible. Learn more: Upgrading from Oracle JDBC 11.2.0.4 Driver to 19.20.0.0 Driver.
Enhanced the Parquet Writer Snap with a Decimal Rounding Mode dropdown list to enable the rounding method for decimal values when the number exceeds the required decimal places.
The SAP Concur OAuth2 Account now supports the Auth endpoint config and Token endpoint config field sets to configure custom properties for the OAuth2 endpoint.
Fixed Issues
Fixed an issue that caused NTLM authentication issues when accessing SMB servers.
Fixed an issue that caused account credentials to be visible in the stack trace of some failed SFTP operations.
Fixed the encoding of special characters in the SAP S/4HANA Update Snap.
Fixed an issue with the Microsoft Dynamics 365 Business Central and Microsoft Dynamics Finance and SCM Snap Packs that caused the Snaps to fail when the string values (filter criteria) were passed without quotes.
Fixed an issue with the Microsoft Dynamics 365 Business Central and Microsoft Dynamics Finance and SCM Snaps that failed to execute after processing less number of records.
Known Issues
The Microsoft Dynamics 365 Finance and SCM Create, Update, and Delete Snaps encounter the following errors intermittently when you run a batch process on the same entity in a pipeline.
500 (Internal Server Error)
Socket timeout error
Read timeout error
Workaround: Increase the Timeout value to 500 (or higher) and decrease the Batch size with the default retry properties.
Custom Snaps
Introduced the /wiki/spaces/SD/pages/2939748353 Snap Pack, to perform powerful combinations of tasks. You can use the utilities to work with object storage efficiently, to chain and parameterize notebooks, and to work with secrets. This Snap Pack includes the following Snaps and an account:
SnapGPT
Improved support for generating expressions in the Mapper Snap with a new review panel in the UI
Added support for answering questions using the SnapLogic documentation knowledge base
Documentation Enhancements
Added instructions for uninstalling Groundplexes in Windows.