Versions Compared

Old Version 191

changes.mady.by.user Kalpana Malladi

Saved on

compared with

New Version Current

changes.mady.by.user Subhajit Sengupta

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Key New Features

AutoSync:

  • Google BigQuery as a destination endpoint.

  • CSV File Reader as a source endpoint.

  • The integration starts within 10 seconds as soon as you click Save and Load.

  • From the dashboard, initiate an ad hoc load by clicking Run now(blue star) in the integration card.

AutoPrep:

  • Rename fields, format Date strings, and mask sensitive data.

API Management:

  • Copy and Move Assets from one API Version to another.

  • Import/Export API policies at the Version level.

  • Change the Host server (Snaplex) of your API Version before publishing and republishing it to the Developer Portal.

Snaps:

  • Introduced the API Suite Snap Pack, which contains the HTTP Client Snap.

  • Introduced the Google AlloyDB Snap Pack, which is a fully managed PostgresSQL-compatible database service that you can use for all your database workloads.

Studio:

  • Metric charts are available from the node details panel.

  • Search supports filtering by Project Space and by Project.

Platform and IIP:

  • APIs for retrieving and adding branches to GitHub.

  • From the UI, create a new GitHub branch.

Dot Releases

Platform

Date of Update

Snaplex Build

Update

main-13879 - 4.30 Patch 2 (Recommended)

We strongly recommend that you use this version for your Snaplexes even if you are currently on a prior 4.30 Snaplex version.

  • Snaps that download drivers are now more robust if a driver download attempt fails.

  • Kafka Acknowledge Snap instances that reference obsolete accounts no longer fail.

  • Ultra Task Pipeline requests do not fail when SAP sources send data in XML format.

  • The SnapLogic Dashboard now displays FeedMaster message queue information.

  • The CORS restriction API policy includes response headers for Access-Control-Allow-Methods, Access-Control-Allow-Orgin, and Access-Control=Expose-Headers.

Snaps

Snap Pack

Date of Update

Snap Pack Version

Updates

SAP

430patches18854

The SAP IDoc Read and SAP IDoc Write Snaps do not display the error messages when the IDoc Read BAPI Name field is empty or wrong as a default value IDOC_READ_COMPLETELY is now assigned to the empty field, otherwise, the Snap considers the specified name.

Marketo

430patches18810

The Marketo Asset Write Snap now does not fail with 601 and 602 errors when the OAuth access token expires or is invalid.

SAP HANA

430patches18852

SAP HANA Snaps now properly handle lineage when used in Ultra Pipelines.

Salesforce

430patches18769

  • The Salesforce Bulk Query Snap now includes the following checkboxes:

    • Match Data Type: Select this checkbox to match the data types of the bulk query job results. On selecting this checkbox, the Object Type field appears that enables you to enter the object type for matching the data type.

    • Include Deleted Records: Select this checkbox to include deleted records in the query result.

  • The Salesforce Delete Snap in REST API no longer fails with NPE if a new OAuth2 account is used.

  • The Salesforce Read Snap now stops gracefully on a forced stop (without throwing cryptic errors).

  • The Salesforce Update and Salesforce Upsert Snaps no longer fail with the message "Error occurred while executing request to Salesforce.com" when a redirection is needed.

Transform

430patches18800

The Sort and Join Snaps now have improved memory management, allowing used memory to be released when the Snap stops processing.

Snowflake

430patches18781

  • The Snowflake Insert and Snowflake Bulk Upsert Snaps now do not fail with the SQL Operation failed error, when you insert the uppercase key name into a mixed-case column if the Preserve case sensitivity checkbox is deselected.

  • The Snowflake Bulk Load Snap now works as expected when you configure On Error with SKIP_FILE_*error_percent_limit*% and set the Error Percent Limit tomore than the percentage of rows with invalid data in the CSV file.

MS Dynamics 365 for Sales

430patches18719

The Dynamics 365 for Sales Create, Dynamics 365 for Sales Update, Dynamics 365 for Sales Upsert, and Dynamics 365 for Sales Delete Snaps now do not fail with the lineage issue for Ultra Pipelines.

Amazon S3

430patches18674

  • Introduced the following Snaps:

    • S3 Archive enables you to archive or change the storage class of an S3 object.

    • S3 Restore enables you to restore an archived S3 object.

    • S3 Select enables you to retrieve a subset of data from an S3 object.

  • The S3 Download, S3 Archive, S3 Copy, S3 Delete, S3 Restore, and S3 Upload Snaps do not have the increased number of active threads accumulated, as they are now released immediately after the execution.

  • The S3 Download Snap no longer fails even when the Pipeline has multiple Snaps after 430patches18348.

  • The S3 Browser Snap output now includes the Storage Class field, which indicates the archived status of the S3 object.

Marketo

430patches18707

Transform

430patches18610

The CSV Formatter and CSV Parser Snaps now support shorter values of Unicode characters.

Xactly

430patches18502

The Xactly Snaps now pass the original input document to the error view successfully.

Workday

430patches18358

The Workday Read, Workday Write, and Workday Cancel Snaps now display all the Services in thesuggestions list using the Public Web Service API that the Snaps failed to use previously

Zuora

430patches17426

The Zuora OpenAPI Snap now does not display the following checkboxes:

  • Pass through

  • Display headers for Get

  • Trust all certificates

  • Enable URL Encoding

Reltio

430patches18173

The Reltio Snaps which previously hung when there was no data or while processing the data will now time out when there is a slow server response.

SnapLogic AutoSync

Breaking Change

If you want to change an existing integration for ServiceNow or Salesforce to load using the SCD2 load method, drop any existing destination tables. Otherwise, AutoSync fails the integration with the error: Error during data load: Pipeline did not complete successfully.

AutoSync provides a no-code, point-and-click interface for loading data into a cloud data warehouse. The October release includes the following new and changed functionality:

  • Bulk load to a Google BigQuery destination:

  • Use CSV files as sources:

  • In the dashboard, the run now button (blue star) starts an ad hoc load. The new button is shown in the following screenshot:

Enhancements

New load options are available for some sources. Refer to Supported Load Methods for the complete list.

Change of Behavior

When you click Save and Load for a new integration, it starts running in 10 seconds instead of 5 minutes, as in the previous release.

SnapLogic AutoPrep

The following new AutoPrep features are available only on the latest version (430patches18454).

New transformation options include:

  • Changing the field data type. (Previously this action was only available from the Select fields menu. Now you can change the type from both places.)

  • Formatting Dates and Date Strings. Selecting one of the available formats transforms the field into a Data String.

  • Renaming a field.

  • Masking sensitive data using an MD5, SHA-1, SHA-256, or SHA-512 algorithm.

In the Preview data pane, click the three dots in the column header to open the transformation options menu:

Options menu

Refer to the video below for a demonstration of date formatting transformation:

Enhancements

The data in the Preview data pane format is easier to read and the buttons have been changed to improve usability:

AutoPrep

Learn more about using AutoPrep.

SnapLogic API Management

Features

Enhancements

  • Change Snaplexes before publishing and republishing API Versions on the Developer Portal.

  • Open the Task dialog to change a Snaplex if it is in an Unpublished API Version.

  • Filter by Type. You can now browse through API Versions in the Portal Manager by Type: API or Proxy.

  • As the logged-in user, your email appears by default in the Email ID of the Publish API Version dialog. You can change the email.

  • View Developer Portal UX improvements, including a high-contrast color scheme and optimized dimensions for UX buttons and labels.

Developer Portal: Before this release

Developer Portal: October 2022

Fixed Issues

  • Subscription counts for applications in the Subscription Manager are reflected accurately.

Change of Behavior

  • Public APIs cannot be used with API Assets in API Manager.

  • Snap Packs and Directories cannot be moved or copied from one API Version to another.

  • Published and Deprecated APIs cannot be deleted when they are on the Developer Portal. You can Retire the API Version, which removes it from the Developer Portal, delete all the Version Assets, then delete the Version from API Manager.

SnapLogic Studio (Preview)

This release provides a new Metrics tab, search enhancements, and a change in the way to navigate to AutoSync.

Metrics Tab in Node Details

Node details now include a Metrics tab that displays charts of key metrics. To open node details:

  1. From the left navigation pane in Studio, click Analyze > Infrastructure.

  2. From the System overview, click a node to open its details.

  3. Select the Metrics tab:

Search Enhancements

Search terms and filters are now preserved when you navigate to a different Studio page if that type of search is valid for the new page. On screens that display Project Assets, you can filter by Project Space and by Project:

Select a Project Space:

Expand a Project Space to select a Project:

Expand Project Space

UI Navigation Change

To open AutoSync from Studio:

  1. Click the arrow next to your avatar and select Return to existing interface:

    Profile menu

  2. On the Designer tab, click the arrow and select AutoSync:

    Open AutoSync

New Patterns in Studio

  • Batch Sync New Leads From Marketo to Amazon Redshift

  • Call a Command Line Utility on the Snaplex Node

  • Changing Case of Attributes

  • Check Failed Pipelines Details

  • Create NetSuite Expense Report

  • Create Record in AWS Redshift for New CSV in Box

  • Create Users in ServiceNow from Salesforce Contacts

  • Determine Changes Between Two Data Files

  • Dropbox Samples via REST API

  • Dynamic Field Extension

  • Enable or Disable a Task

  • Encrypt and Decrypt Sensitive Data in a Source

  • Excel to SQL Server after Clearing the Lookup Table

  • Export Accounts from Adaptive Insights

  • Look up Addresses From Multiple Databases

  • Move Salesforce Opportunity to NetSuite Sales Order

  • MQTT to Azure Data Lake

  • NetSuite Case to ServiceNow Incident

  • Oracle to XML File

  • Sync Excel to Marketo

  • Sync New or Updated Leads From Microsoft Dynamics CRM to Marketo

Learn more about the Patterns available in Studio.

Known Issues

When Pipelines extend horizontally or vertically beyond the edge of the Designer canvas, the scrollbars might disappear or not allow you to scroll to view all of the Snaps.

As a workaround, try the following:

  • Select (blue star) to zoom to fit

  • Zoom out completely

  • If more than one Pipeline is open, toggle between Pipeline tabs

SnapLogic Snaps

New Snaps

  • API Suite: Introduced the API Suite Snap Pack, which contains the HTTP Client Snap. This Snap unifies all HTTP-supported methods: GET, HEAD, POST, PUT, DELETE, OPTIONS, TRACE, and PATCH that you can execute on a REST API service endpoint (Snap Pack version: 430patches18454, both Latest and Stable).

  • Google AlloyDB: Introduced the Google AlloyDB Snap Pack— a fully managed PostgresSQL-compatible database service that you can use for all your database workloads. This Snap Pack contains the following Snaps:

    • AlloyDB Bulk Load: Enables you to load data in bulk into the AlloyDB tables.

    • AlloyDB Delete: Enables you to execute a SQL DELETE.

    • AlloyDB Execute: Enables you to execute an arbitrary SQL.

    • AlloyDB Insert: Enables you to execute an SQL INSERTusing the document's keys.

    • AlloyDB Lookup: Enables you to look up records in the target AlloyDB table and return a selected set of fields for every matched record.

    • AlloyDB Select: Enables you to fetch data from the AlloyDB database by providing a table name and configuring the connection.

    • AlloyDB Table List: Enables you to connect to the database, read its metadata, and output a list for each table.

    • AlloyDB Update: Enables you to execute an AlloyDB UPDATE. 

Enhancements

  • The Snowflake - Bulk Load Snap now has a Validation Errors Type dynamic field, which provides options for displaying the validation errors. You can now choose Aggregate errors per row to display a summary view of errors (Snap Pack version: 430patches18432, Latest).

Known Issues

  • The HTTP Client Snap fails with the Name may not be null error when the Key-Value pair values are empty for x-www-form-urlencoded Entity Type.

  • The AWS Sig V4 Account of the HTTP Client Snap does not support the Virtual Private Cloud (VPC).

Fixed Issues

  • The Metadata Delete Snap /wiki/spaces/AP/pages/1438605 deletes Projects from an Org. Previously, Delete operations resulted in the following error message: "Only assets in Org recycle bin can be deleted permanently" 400 Error code.

  • The CSV Parser Snap now parses data with empty values in the columns when using a multi-character delimiter.

Platform and IIP

Features

New Git-related Public APIs are available:

Enhancements

  • Pipeline owners can now access the Execution Statistics of a child Pipeline, even if they do not have read access to the parent Pipeline.

  • Create a branch during checkout from the IIP in Manager:

  1. From the Project options menu, choose Checkout GitHub Repository:

    Project options menu

  2. Select a repository and a branch, the new branch will be created from the selected branch.

  3. In the Branches/Tags field, enter a new name:

  4. Click Checkout.

Documentation Updates

  • An AutoPrep example with sample data demonstrates how to transform data without writing expressions.