In this article:

Platform 

New Features and Enhancements

• Insights dashboard: Revamps the Insights dashboard to provide data visualization of Org-level Pipeline-execution statistics for a specific date range.
  
  
  
• Task monitoring: Adds a new tab for Tasks under Dashboard that does data visualization of triggered and scheduled tasks for a selected time range. The new tab displays the number of failed and completed executions for each task type along with their details.
  
  
  
• Snap auto-configuration: Enhances the suggestion capabilities of Iris to include Snap auto-configuration in Snaps with suggestible properties. Iris Expression recommends the configuration of these properties based on similar Snap settings from Pipelines that you can access. 
  
  
  

• Sticky Notes in SnapLogic Designer: Introduces the ability to add notes to a Pipeline in SnapLogic Designer. This enables you to collaborate with multiple Pipeline developers or add important notes for complex Pipelines. The notes are included in the Pipeline metadata and are immediately visible to other users accessing the Pipeline.
  
  

  Known Issue

  When you copy a Pipeline with Sticky Notes, the notes are also copied with the Pipeline. Additionally, when you modify or add Sticky Notes in the copied Pipeline, the notes in the original Pipeline are also updated.

• Target recommendation: Enhances the Iris Expression recommendation capabilities to include Target path suggestions in Mapper Snap. Iris recommends Target paths based on exact matches between Expression and Target paths from other Pipelines in your Org. 
  

Known Issues

• A Triggered Task on a Groundplex with an underlying Pipeline that contains child Pipelines might stall as the Data Validator Snap is executing in the parent Pipeline.
• An Ultra Pipeline sometimes processes the same message twice even though the message was processed successfully during the first attempt. 

Updates to Expression Behavior

• Starting in the 4.21 Release (May 2020), the escaping required in the replacement text of the ReplaceAll function is identical to that of the Replace function. Prior to this release, you had to use additional escaping in the replacement text with ReplaceAll to get the desired output.

  Previous Behavior	New Behavior
  Example: $msg.replaceAll("-", "\\\\-") where $msg contains mother-in-law Result: mother\-in\-law	Example: $msg.replaceAll("-", "\\-") where $msg contains mother-in-law Result: mother\-in\-law

• Starting in the 4.21 Release (May 2020), the Date.parse() function returns the response text Not a Number when you enter a non-number or infinity. Prior to this release, doing either resulted in an error, even though the formatting of the string was correct.

  Previous Behavior	New Behavior
  Example: $date.parse(Math.abs(1/0)) where $date is infinity Result: 1970-01-01T00:00:00.000 UTC Example: $date.parse(“foo”, “yyyymmdd”) Result: Error	Example: $date.parse(Math.abs(1/0)) where $date is infinity Result: Not a number Example: $date.parse(“foo”, “yyyymmdd”) Result: Not a number

Standard-mode Snaps

New Snaps

• SharePoint Online Snap Pack: This Snap Pack enables organizations to share and manage content and collaborate across an organization using the following SharePoint Online Snaps:
  
  • SharePoint Online - Get Item: Retrieves metadata of an item (files/folders) from SharePoint Online document library.
  • SharePoint Online - Create Item Permission: Creates permissions for an item and shares the same via email to the configured set of recipients.
  • SharePoint Online - Delete Item Permission: Deletes permissions for a specific SharePoint Online item.
  • SharePoint Online - Download File: Enables downloading the content of the primary stream (file) of an item.
  • SharePoint Online - Search Items: Searches for the hierarchy of items matching the search query within a folder hierarchy, a whole drive, or files shared with the user.
  • SharePoint Online - Item Children: Retrieves metadata of items from the selected SharePoint Online document library.
  • SharePoint Online - Copy Item: Copies the item resource path that represents a folder or file stored in a document library.
  • SharePoint Online - Update Item: Updates a name or moves an item (file or folder) within SharePoint Online.
  • SharePoint Online - Create Folder: Creates a folder in a SharePoint Online document library and stores the metadata in a file.
  • SharePoint Online - Delete Item: Deletes items from the SharePoint Online document library.
  • SharePoint Online - Document Library: Retrieves the document library metadata of a site.
  • SharePoint Online - Get Item Permissions: Retrieves permissions of an item from the SharePoint Online document library.
  • SharePoint Online - Update Item Permission: Updates an item permission associated with an item/folder of SharePoint Online document library.
  • SharePoint Online - List DeleteItem: Deletes a particular list item from a SharePoint Online site.
  • SharePoint Online - List UpdateItem: Updates the values of an existing list item in a SharePoint Online site.
  • SharePoint Online - Create List: Creates a list or list item in the SharePoint Online site.
  • SharePoint Online - List Read: Reads metadata of a list along with its columns and items from the SharePoint Online site.
  • SharePoint Online - Upload File: Uploads the contents of a new file or updates the contents of an existing file in a document library.

• Adobe Experience Platform Snap Pack: This Snap Pack enables you to integrate with the new Adobe Experience Platform and includes the following Snaps:
  • Adobe Experience Platform File Generator: Generates an Adobe Enterprise Platform (AEP)-compatible file by restructuring upstream data to match a specific schema stored in AEP.
  • Adobe Experience Platform S3 Connector: 
    • Enhances the Snap by removing the Create New Dataset checkbox. The Snap now automatically creates a new dataset if it does not exist.
    • Retrieves data from AWS S3 and writes it into AEP.  
  • Cassandra: Extends support to Cassandra version 3.11.5.
  • Adobe Experience Platform Write: Writes data from upstream Snaps into AEP.
    
    
• SAP S/4HANA Snap Pack: This Snap Pack supports the SAP S/4 HANA on-premise environment and includes the following Snaps:
  • SAP S/4HANA Read Snap: Retrieves data from SAP S/4 HANA applications. 
  • SAP S/4HANA Create Snap: Creates data objects in SAP S/4 HANA applications.
  • SAP S/4HANA Update Snap: Updates data in SAP S/4HANA applications.
  • SAP S/4HANA Delete Snap: Removes data objects from SAP S/4HANA applications.
    
    
• ML Data Preparation: Introduces the Mask Snap that enables you to hide sensitive information in your dataset before exporting the dataset for analytics or writing the dataset to a target file.

Updated Snap Packs 

• Adobe Experience Platform Snap Pack: Enhances the Adobe Experience Platform S3 Connector Snap by removing the Create New Dataset checkbox. The Snap now automatically creates a new dataset if it does not exist. 
• Cassandra: Extends support to Cassandra version 3.11.5.
• Confluent Kafka: Enhances the Kafka Consumer Snap to significantly reduce the volume of commit requests for offsets when using the record acknowledgment mode (Wait after each record), and thereby, improve performance and stability.
• ML Data Preparation: 
  
  • Enhances the Match Snap to add a new field, Match all, which matches one record from the first input with multiple records in the second input. Also, enhances the Comparator field in the Snap by adding one more option, Exact, which identifies and classifies a match as either an exact match or not a match at all.
  • Enhances the Deduplicate Snap to add a new field, Group ID, which includes the Group ID for each record in the output. Also, enhances the Comparator field in the Snap by adding one more option, Exact, which identifies and classifies a match as either an exact match or not a match at all.
  • Enhances the Sample Snap by adding a second output view which displays data that is not in the first output. Also, a new algorithm type, Linear Split, which enables you to split the dataset based on the pass-through percentage.
• NetSuite 

  • Removes the obsolete Sandbox Account check box from the NetSuite Token Account.

  • Removes the now redundant Custom WSDL URL Domain field from the NetSuite Token Account to support NetSuite's transition to automatic account-specific domain identification.

• Oracle: Updates the Oracle Thin Account and Oracle Thin Dynamic Account, enabling them to connect via Oracle Active Data Guard (ADG).

• SAP: Enhances the SAP Execute Snap to add a new field, Output date time as Text, which enables you to output date and time as a String data type instead of a DateTime object.

• Script Snap Pack: Adds a new Cleanup method in the ScriptHook interface associated with the Script Snap. This method enables the Script Snap to automatically execute a clean-up once the configured script completes executing.

• ServiceNow: Adds support for ServiceNow Madrid, New York, and Orlando versions.
• Transform: Adds support in the Mapper Snap to display schemas with complex nesting. For example, if Snaps downstream from the Mapper Snap have custom fields that contain multiple keys, then these keys automatically display in the Mapper Snap's Target Schema dropdown list when you toggle-off Expression Builder and select the field in the Mapping Table.

Known Issues

• In some Snaps, if you leave any expression-enabled mandatory fields empty, a null pointer exception error message might display instead of the usual error message on validation.

• Cassandra: 

  • The Cassandra Snap Pack does not support the following data types introduced in Apache Cassandra V3.x:

    • DateRange

    • Duration

    • Geo-spatial data types such as Point, Polygon and LineString

  • Snaps in this Snap Pack display an exception when you query a map column that has a timestamp as the key.

• Google Big Query Snap Pack: The Snaps no longer return the affectedRowCount field with a null value for DML (data manipulation language) queries. The said field no longer exists.
• MySQL: When MySQL Execute Snaps (MySQL - Execute and MySQL - Multi Execute) are followed by MySQL Snaps, such as MySQL - Insert, MySQL - Merge, they display the following error when executed: 
  Table definition has changed, please retry transaction.

  This happens due to a known issue in the MySql Database. For more information, see MySQL Bug #65378.

• Parquet Writer (Behavior Change): In the 4.20 Snap version (snapsmrc535 and hadoop8776) when a value for a field defined as repeated (for example, devops in the below example) is not present in the input document, the Parquet Writer Snap displays "The required field 'devops' is missing from a document" error. However, in the 4.21 release, the Parquet Writer Snap outputs a null value when there is no input for the repeated fields. If this behavior change impacts your existing Pipelines having the Parquet Writer Snap, then you might want to consider potentially redesigning your impacted Pipelines.

  repeated group devops {
  required binary lan (UTF8);
  optional binary lan2 (UTF8);
  }

eXtreme (Big Data) 

New Features and Enhancements

• Cross Account IAM Role Support: Users can now specify cross-account IAM role for an AWS account to spin up an eXtremeplex on AWS EMR without needing to share secret and access keys of their AWS accounts. 

• Enhanced Account Encryption: Introduces Enhanced Account Encryption (EAE) support for AWS accounts. This enables you to encrypt and secure account credentials that access endpoints from SnapLogic using a private key/public key model. The data is encrypted with a public key before it leaves the browser, then decrypted with a private key on the eXtremeplex.
• Publicly Available Datasets: Provides free limited datasets in our public AWS S3 bucket and Azure Databricks clusters. You can use these datasets to try out the eXtreme use case Pipelines. Alternatively, you can also generate your own TPC-DS benchmark datasets to use with these Pipelines. 

New Snaps

• Spark SQL 2.X Snap Pack: Enhances the Snap Pack to support Java Database Connectivity (JDBC). This enhancement adds the following Snaps and account type:
  • JDBC Insert: Inserts data into a target table through a JDBC connection. 
  • JDBC Select: Fetches data from a target table through a JDBC connection. 
  • JDBC Storage Account: Enables you to connect to databases that support JDBC.
    

Known Issue

• eXtreme Execute Snap Pack: The Spark job continues being in the running state even after the SnapLogic Designer/Dashboard displays the Pipeline status as failed on AWS EMR. 

Prior 4.20 eXtreme Dot Releases in 4.21 GA 

The following 4.20 eXtreme (Big Data) Dot Release update is now a part of the 4.21 GA release.

4.21 UAT Delta

4.21 Dot Releases