February 2022, 4.28 Release Notes

 

In this article

Key New Features in SnapLogic

Platform:

  • New Public API endpoints to facilitate integration with your CI/CD tools:

    • Create new Project Spaces and Projects to run your tests.

    • Manage Permissions in specific Orgs as you promote Pipelines and Assets.

    • List Git status of Assets.

API Management: 

  • Expand your API ecosystem to manage, secure, and control third-party and public APIs through the API Management solution.

  • Secure external APIs with policies for security, traffic management, and more.

Developer Portal:

  • Improved application development time by testing and sampling custom APIs within the Developer Portal using the “Try it out” feature in the API documentation page.

Snaps and Accounts:

  • Added Azure Service Bus Snap Pack.

  • Added Exact Online Snap Pack.

  • Added Active Directory Remove Member Snap.

  • Added SharePoint Online - Get Sites Snap.

  • Added OAuth2 Account support for ServiceNow Snap Pack.

  • Added OAuth2 Account support for SuccessFactors Snap Pack.

  • Added OAuth2 Account support for Snowflake Snap Pack.Snowflake Snap Pack.

ELT for Cloud Data Platforms:

  • Subquery Pushdown Optimization.

  • Added new ELT Snaps: ELT Coalesce, ELT Conditional Function, ELT Math Function, and ELT SQL Case Expression.

  • Support for loading data from S3 and Redshift source locations to BigQuery target tables.

SnapLogic Flows:

  • Added Webhook support for Salesforce and HubSpot.

  • Added two new endpoints: HubSpot and Jira (source).

  • Added Auto Data Type Conversion.

Flows is available to you free with your current SnapLogic subscription, but only for a limited time. To get started, register for Flows.

4.28 UAT Delta

This section tracks the changes made during the iterative pushes to the UAT server and the GA release. The following is the release schedule:

  • UAT 1: Friday, Feb 4, 2022 – Snaplex version: 4.28_rc-11090 - 4.28 RC (Recommended)

  • GA: Saturday, Feb 12, 2022 – Snaplex version: main-11177 - 4.28 GA (Recommended)

The SnapLogic GA release build on the production server is also deployed on the UAT server.

Important

  • Per the SnapLogic Release Process, all remaining Snaplex instances across Orgs are auto-upgraded to the recommended version (main-11177 - 4.28 GA) at 9 p.m. PT on Saturday, Mar 19, 2022. Orgs migrated to the 4.28 GA version prior to the auto-upgrade are not impacted. 
    The Snaplex upgrade process also upgrades the Java version to the latest version. After the upgrade, the Java version of your Cloudplex nodes may not be the same as your FeedMaster nodes. However, this does not impact the operations of your SnapLogic instance. We will be fixing this issue in a subsequent release.

  • To use the new SnapLogic features and Snaps in the 4.28 release, ensure that your Snaplex nodes are upgraded to the main-11177 - 4.28 GA (Recommended) version.

  • This 4.28 release includes the patches deployed to SnapLogic after the 4.27 release, as listed in the 4.27 Dot Releases section. 

4.28 Dot Releases

SnapLogic Studio

Date of Update

Update

Date of Update

Update

Mar 31, 2022

Removed Last Execution and Last Status in the Execution Overview to improve performance.

Snaps

Snap Pack

Date of Update

Snap Pack Version

Updates

Snap Pack

Date of Update

Snap Pack Version

Updates

ELT

Apr 20, 2022

428patches15638

Fixed the issue with ELT Merge Into Snap where the Snap erroneously modified the target table column name when it contained the target table name, due to a misinterpretation of the target table name aliases.

Snowflake

Apr 12, 2022

428patches15236

  • Updated the Snowflake - Bulk Upsert Snap for the following:

    • The Snap displayed an incorrect resolution when the length of the value exceeded the value defined in a column.

    • The Snap failed with a NullPointer Exception when no value was provided for Error Limit field and Error percentage limit fields.

    • The Snap displayed an incorrect error message when S3 details were not provided.

    • Added the On Error dropdown list, where you can select an action to perform when the Snap encounters errors in a file.

On Error: Use this field to select an action to perform when the Snap encounters error in a file. The available actions are:

- ABORT_STATEMENT: Aborts the upsert action and displays an error.

- CONTINUE: Continues loading the file. The error is displayed in the output document.

- SKIP_FILE: Skips upserting the files that contain errors.

- SKIP_FILE_*error_limit*: Skips file when the number of errors in the file exceeds the number specified in the Error Limit field.

- SKIP_FILE_*error_percent_limit*%: Skips file when the percentage of errors in the file exceeds the percentage specified in the Error Percentage Limit field.

Default value: ABORT_STATEMENT
Example: SKIP_FILE

  • Removed the Username field in the following accounts to allow reusing of accounts among different users:

  • The following enhancements were done for Snowflake - Bulk Load Snap:

    • The Snap skips AWS account validation if S3 Storage Integration property is provided.

    • The Snap skips the validate command if S3 Storage Integration property is not provided

    • The Snap overrides the storage integration specified in the account settings with the storage integration specified in the Snap settings.

  • Enhanced the Snowflake - Unload Snap to skip AWS account validation if S3 Storage Integration property is provided.

Google BigQuery

Apr 12, 2022

428patches15459

  • Fixed an issue with Google BigQuery Execute Snap, where the Snap displayed 404 Job not found error when calling a procedure.

  • Fixed an issue with the Google BigQuery Bulk Load (Cloud Storage) Snap where the Snap failed, because the access token expired when it had to wait longer to execute. With this fix, the Snap is reloaded to get refreshed access token.

MySQL

Apr 12, 2022

428patches15101

Fixed an issue with SQL Server - Execute Snap where the Pipeline was failing when there were consecutive execute Snaps with a procedure call, followed by select statements.

SharePoint Online

Apr 6, 2022

428patches (main101)

Fixed the Auto Refresh Token issue in the SharePoint Online Account.

REST

Mar 28, 2022

428patches15172

Fixed an issue that caused REST SSL accounts to fail when the username in the REST SSL Account was null and the Enhanced Encryption level was low, medium, or high.

SQL Server

Mar 25, 2022

428patches14649

Enhanced the SQL Server - Select and SQL Server - Lookup Snaps with Option for Unique Identifier Column that allows you to convert the case to lower or upper while displaying the Unique Identifier output (display) value.

Option for Unique Identifier Column: This field is applicable only when the Snap returns the unique identifier (GUID) in the output. The unique identifier is stored in the database using an internal format and when it is displayed in the output, it is converted to a string and gets displayed in upper case for HEX characters. Select either of the following options to change the case type. Available options are:

- Convert to lower case: Modifies the output string to lower case.

- Convert to upper case: Modifies the output string to upper case.

Default Value: Convert to lower case
Example: Convert to upper case

JWT

Mar 24, 2022

428patches15200

Enhanced the JWT Generate Snap to include the typ field in the JWT Header of the JWT token.

{
"alg": "HS256",
"typ": "JWT"
}

ELT

Mar 24, 2022

428patches15290

  • Updated ELT SCD2 Snap to address different feature requests and issues raised by multiple customers. These changes provide more flexibility in configuring your SCD2 operations using this Snap.

    • Removed Check for nulls and duplicates in source field and added two dropdown lists - Null Value Behavior and Invalid Row Handling.

    • Refer to the ELT SCD2 scenarios to learn more.

  • Introduced a new Snap ELT Router to enable routing input SQL queries into multiple output views based on the given conditional expressions.

Google Sheets

Mar 24, 2022

428patches14755

Enhanced the Spreadsheet Browser Snap with the Fetch Mode dropdown list to fetch the spreadsheets and worksheets.

The Fetch Mode list has the following options:

- Spreadsheets and Worksheets: Fetches Spreadsheets and Worksheets within the Spreadsheet.

- Spreadsheets: Fetches only the Spreadsheets.

Default Value: Spreadsheets and Worksheets
Example: Spreadsheets

Email

Mar 24, 2022

428patches14812

Fixed an issue with the Email Sender Snap where SMB files were attached to an e-mail causing the Snaps to fail with a NullPointer Exception.

MS Dynamics 365 for Sales

Mar 23, 2022

428patches15219

Updates in the MS Dynamics 365 for Sales Create and MS Dynamics 365 for Sales Upsert Snaps:

  • Improved performance by streamlining the process of creating new entities.

  • Fixed an issue where the Content-Length header was incorrectly set when Unicode characters were present in the request.

Hadoop

Mar 23, 2022

428patches15216

Added the AWS S3 Dynamic account for Parquet Reader and Parquet Writer Snaps.

Flow

Mar 22, 2022

428patches15026

Fixed an issue with HTTP Router Snap where the Snap did not work as intended for a GET request that used a Cloud URL when the HTTP Router was the first Snap in the triggered task Pipeline.

Azure SQL

Mar 22, 2022

428patches15164

Fixed an issue with the Azure SQL - Update Snap where the Snap failed with an Incorrect syntax error when a column in a table is of NVARCHAR, NCHAR, or NTEXT data type and this column is part of another NVARCHAR, NCHAR, or NTEXT data type column name and the update condition is specified as an expression.

Binary

Mar 17, 2022

428patches14919

  • Fixed an issue with the Directory Browser Snap where the Snap failed while parsing the value in the Amazon S3 client region.

  • Enhanced the File Writer Snap with the Prevent URL encoding checkbox to manage the URL encoding.

  • Fixed an issue with the ZipFile Write Snap where the Snap displayed a null pointer exception when the path in the upstream File Reader Snap started with "../".

  • Fixed an issue in the Binary Snaps (that support SMB file protocol), which displayed an SMB Mount error when trying to connect to Mount Share.

  • Fixed an issue with the File Writer Snap where the Snap did not display an error when an error occurred while writing a file.

Azure SQL

Mar 16, 2022

428patches15114

Fixed an issue with the Azure SQL - Bulk Load Snap where the decimal values lost precision when they were inserted into the database.

Amazon SQS

Mar 10, 2022

428patches14774

Fixed an issue in the SQS Consumer Snap where the Snap took longer time to process the messages when the Client-side buffering checkbox was selected.

Binary

Mar 10, 2022

428patches14736

Fixed an issue in the File Writer, S3 File Writer, and ZipFile Write Snaps where the Snaps failed with AccessControlListNotSupported error when using an external AWS account to write to the bucket if it has the bucket-owner-enforced setting enabled. With this fix, you can select the None option (the default value), from the AWS Canned ACL dropdown list, indicating that no Canned ACL request is set when writing a new file to prevent the error.

Workday

Mar 4, 2022

428patches14290

Enhanced the Workday Cancel Snap with retry mechanism fields.

Kafka

Feb 28, 2022

428patches14904

Fixed an issue with Kafka Snaps where the Snaps failed with null pointer exceptions when logging the cluster information with the controller’s identity not known.

Transform

Feb 25, 2022

428patches14370

Fixed an issue with the XML Generator Snap, where the Snap failed with an invalid UTF-8 sequence error when running on the Windows Snaplex.

Splunk

Feb 24, 2022

428patches14332

Upgraded the Splunk library to version 1.6.5.0 to fix an issue with the Splunk Search Snap, where the Snap displayed a 401 Unauthorized access error despite entering valid credentials.

SalesForce

Feb 24, 2022

428patches14355

Fixed an issue with Salesforce Snaps where the Service Version could not be retrieved from SFDC due to a blocked URL, failing the Snap execution.

Google BigQuery

Feb 23, 2022

428patches14743

  • Fixed an issue with the Google BigQuery Execute Snap, where the Snap displayed an error when the input data contained a table having the record type column and its value was null.

  • Fixed an issue with the Google BigQuery Write Snap, when the input data contained complex data type columns (such as nested fields) and Create table if not present checkbox was selected.

Platform 

New Features

Enhancements

  • Updated the Snaplex installer to use JRE 11.0.12+7 instead of 11.0.10+9. We have committed to upgrade the version twice a year as part of security compliance. New Groundplex installations will use this version, and Cloudplex installations will get upgraded as part of the version upgrade. Existing Groundplex installations will continue on the current version until the RPM/DEB is manually reinstalled.

Fixed Issues

  • Fixed the issue in ServiceNow Snaps where Number of Retries was showing empty or blank values.

  • Fixed 404 errors when selecting 8 Hours or 24 Hours in the Dashboard under the Health tab.

  • Fixed the missing default value for Skip lines in the CSV Parser Snap settings dialog.

Known Issues

  • When creating new Projects using the Public API (POST /project/{projpath}), the checkout Public API (POST /project/checkout/{project_path}) is currently unable to create the initial link between the Project and the repository, and the checkout will fail. As a workaround, check out using the UI. Target fix version: 4.28 patch in March.

  • When committing files to GitHub from SnapLogic, some subdirectories might be inadvertently deleted from the repository, including GitHub Actions workflows in the .github directory. Target fix version: 4.28 patch in March.

API Management

New Features

  • Proxies. SnapLogic's new Proxies feature allows you to seamlessly integrate with your custom APIs and third-party APIs by providing API administration, monitoring, and security management within the API Manager.

    List of reverse proxies in the API Manager, showing the new dropdown for the plus icon

 

  • Naming restrictions for APIM assets. The following restrictions now apply to the names for API Manager assets (APIs, API versions, Proxies, Proxy Endpoints):

    • Must be unique.

    • Must begin with alphanumeric characters A-Z, a-z, or 0-9.

    • Cannot contain the reserved keyword shared.

    • Cannot contain |, <, >, [, ], {, }, #, ?, /, and \.

    • Must be no more than 256 characters. If the name includes double-byte characters, the maximum length is shorter.

 

1. Go to the API Manager and select the API.

2. In the Versions tab, select the version.

3. In the Assets tab, select the assets to delete.

4. Click the trash icon ( ).

List of assets with checkboxes and trash icon

Developer Portal

New Features

  • Try It Out. You can now test your APIs in the Developer Portal using the Try it out button. It works with all APIs with only two requirements:

    • The API must include a CORS Restriction policy.

    • The API must be published.

 

Enhancements

  • Account and Subscription Management Based on User Role. Only Org Administrators can manage (create, approve, deny, or delete) Developer Portal user accounts and API subscriptions. System Administrators and regular users can only view these users and API subscriptions.

Snaps

New Snaps

Azure Service Bus: A cloud messaging service that connects applications, devices, and services running in Azure Cloud to any other applications or services. This Snap Pack offers the following Snaps:

Exact Online: Allows companies to speed up their business process and automation for payroll, expenses, and other accounting workflows. This Snap Pack offers the following Snaps:

Active Directory: Added the Active Directory Remove Member Snap that enables you to remove an existing member from a specified group in Active Directory.

SharePoint Online: Added the SharePoint Online - Get Sites Snap that enables you to get the list of sites specific to the logged-in user from the SharePoint Online site.

Snap Enhancements

  • Binary

    • Enhanced the File Operation Snap to support Azure Data Lake Storage (ADLS) Gen2 protocol for moving and copying files in the Azure Blob File System (ABFS).

    • Fixed an issue with the File Poller Snap to enhance the performance of the polling operations that allow the Snap to poll the files without stopping.

    • Enhanced the S3 File Writer Snap with the Suggest fully-qualified file names checkbox that allows you to use fully-qualified file names in the File name Suggestions list for gov cloud instances.

    • Enhanced the File Writer, S3 File Writer, and ZipFile Write Snaps with the AWS Canned ACL (Access Control List) permission mode that enables you to use Canned ACLs when creating the S3 Object. This feature allows you to grant full access of the object to the S3 bucket owner.

  • Database Delete Snaps

  • Flow: Enhanced the Filter Snap with the Null-safe access checkbox. Select this checkbox to consider the valid values in the filter expression and remove the missing or empty data instead of treating them as null.

  • JDBC

  • Marketo Snap Pack: Enhanced the Bulk Lead Extract and Bulk Lead Upsert Snaps with retry mechanism fields to set a time limit to complete the processing of operations:

    • Timeout (seconds)

    • Number of Retries

    • Retry Interval (seconds)

  • ML Data Preparation: Enhanced the Type Converter Snap with the Fail safe upon execution checkbox. Select this checkbox to enable the Snap to convert data with valid data types, while ignoring invalid data types.

  • Oracle

    • Enhanced the Oracle - Update Snap to accept values in the Number of Retries and Retry Interval (seconds) fields from Pipeline parameters only. 

    • Enhanced the