• Introducing the following major enhancements to the API Management service:

  • API Manager: Enables API Developers to control access, discoverability, and approval of Proxies. It also enables users to add and delete other users for consuming APIs created in SnapLogic.

  • Developer Portal: Enables non-SnapLogic users to consume APIs created in the SnapLogic platform.

• Single Sign Out (SSO): Enhances SSO options with the capability to enforce logging out users.

• Pipeline Runtime ID: After the Snaplex instances update to 4.18, the runtime ID for Pipelines will have the following changes:

  • The Pipeline Runtime ID increases in length from 36 characters to 61 characters. If the ID is saved externally, the storage size must increase.

  • The status API for Snaplex nodes returns limited information unless called with user authentication information.

To support in-built High Availability (HA) and Disaster Recovery (DR) capabilities for customer organizations that are subscribed to Cloudplex instance in North America, SnapLogic is migrating its Cloud infrastructure. In addition, Groundplex connectivity IP address will also change. Therefore, it is critical that you read the Snaplex IP Address Whitelist Update document.

Starting from 4.18 release, SnapLogic supports Java 11 for Groundplex instances. We recommend customers to migrate to Java 11, since Oracle no longer releases security updates for Java 8. 

For details, see Upgrading Your Groundplex to Java 11.

• End of support for Nested Pipelines: Starting from the 4.18 release, we no longer support the guaranteed delivery option for Nested Pipelines (also known as sub-Pipelines). We recommend that you use the Pipeline Execute Snap instead of sub-pipelines. You can use the Pipeline Execute Snap with Resumable child pipelines to handle scenarios where exactly-once-delivery is required. Contact your SnapLogic Account Manager for further details.

• SFTP connection for Snaps: We are reverting the default value for maxSftpChannels to 1. In the 4.17 release, the maxSftpChannels default value was set to 2. However, to keep only one open channel, the value is reverted to 1. Having only one open channel avoids caching of open sessions if all the channels are closed.

The following 4.17 Platform Dot Release updates are now a part of the 4.18 release:

• Data Preview: We are enhancing the Data Preview functionality in Pipelines with new types of graphs.
  

• Pipeline Recommendation: We are enhancing the suggestion capabilities of Iris to include Pipeline Recommendations. You can now switch from Snap to Pipeline suggestions at a single click. Iris' new functionalities enable you to do the following when designing your Pipelines: 

  • Based on the Pipeline label and the Snaps on the canvas, you can view a gallery of Pipeline shapes, and can choose a Pipeline to open.

  • Iris suggests Pipelines from 3 sources -- existing Pipelines that you have access to, Pattern Pipelines from SnapLogic Cloud Pattern Catalog, and artificially synthesized Pipelines.

  • You can open one of the Pipeline shapes as a new Pipeline.

  • You can also replace the partially configured Pipeline with the Pipeline shape from the gallery. 

    Open

    

    
    
    

• Iris Assistant: You can now use a new option to search for Pipelines using keywords, while also benefiting from improved Snap search capabilities.

  • Snap Search: When you search for a keyword that does not match any Snap name, Iris provides suggestions based on the content on the SnapLogic documentation site. 

    Open

    

    
    
    

  • Pipeline Search: When you search for a Pipeline, Iris displays a list of project spaces and projects that contain Pipelines that match the search terms. The Pipelines are indexed on an hourly basis and new Pipelines are not displayed in the search until the next refresh happens.
     

    Open

    

• API Manager: We introduce a new page in Settings for API developers with Org-level admin access to control access to APIs and their discoverability type. From API Manager, you can also publish APIs to the Developer Portal. The API Manager puts all your Proxies for an Org in one place. Besides Proxy details, you can also view users, access types, and web applications that consume your Proxies.
  
  
  
  

• Snaplex Node Disk Notification: We are introducing a Snaplex notification for JCC (Java Containerized Component) node disk usage. As an Org-level admin, you can create a notification that alerts users when the threshold for available capacity has been exceeded.

• Data Lineage: Introducing a new tab in Dashboard that provides a visualization of all the data sources to which Pipelines connect. You can now select one or more Pipelines and fetch the data sources for those Pipelines. Conversely, you can start with a data source, and view the list of Pipelines that interact with it.
  

Introducing an API Catalog to which API Developers can publish API Proxies. From the API Manager, you can access the Developer Portal, a new UI that requires a unique set of credentials.

• Allows non-SnapLogic users to search and explore APIs created in SnapLogic.

• Enables consumers to consume APIs.

• Certain output of JSON Parser Snap may display truncated or inaccurate data. For example, a numerical output value 0.19331011717644054 displaying as 0.19331011717644053.

The following 4.17 UI Dot Release updates are now a part of the 4.18 release:

Adobe Cloud Platform Snap Pack

• Enhances the Snap Pack to support the Map datatype in XSD-based datasets. 

Binary Snap Pack

• Adds a new account type, Google Service Account, which enables you to isolate workflows from individual users. This support applies only to the Google Storage file protocol.

Box Snap Pack

• Adds a new account type, Box Service Account, which enables you to create user accounts that can only be accessed programmatically through the APIs.

• Adds new properties, Number of retries and Retry interval (seconds), in the Box Write Snap to handle failed write attempts.

Hadoop Snap Pack

• Adds ADLS Gen2 support for ABFS (Azure Blob File System) and ABFSS protocols to the HDFS ZipFile Reader, HDFS ZipFile Writer, HDFS Reader, ORC Reader, Parquet Reader, and Hadoop Directory Browser Snaps. This support enables overriding account name and endpoint details in the Account Settings fields with those that are provided in the URL.

MongoDB Snap Pack

• Mongo DB Find: Adds the following new fields:

  • Projection Condition: Specifies which fields must be returned in the matching documents.

  • Sort Condition: Specifies the sort order for documents in the result set.

  • Offset: Specifies the starting document for the FIND query.

  • Limit: Specifies the number of documents the FIND query must return.

  • Group result: Groups the find query results in one field named result, instead of an array.

• MongoDB Group: Adds a new Snap that enables you to group input documents by a specified expression, and output to the next stage, one document for each distinct grouping.

• Mongo DB Update: Adds two new fields, Update operation and Exclude list, which enable you to update operations and exclude a list of JSON properties before sending the updated documents to MongoDB.

JDBC Snap Pack

• Adds support for JDBC account Active Directory authentication for SQL server for driver JAR version mssql-jdbc-6.2.2-jre8.jar.

MySQL Snap Pack

• Reverts a 4.17-patch (db/mysql7395) update regarding how BIT and BOOLEAN column data type values are displayed. They now display as true or false (4.17 GA behavior now in snapsmrc523) rather than converting to 0 or 1 values (4.17-patch behavior).

Script Snap Pack

• PySpark: Enhances to work in Kerberized Hadoop clusters, with the addition of a Kerberos account.

Snowflake Snap Pack

• Multi Execute: Adds a property, Use Result Query, which enables you to write results to an output view.

SQL Server Snap Pack

• Adds support for SQL Server account Active Directory authentication for SQL server for driver JAR version mssql-jdbc-6.2.2-jre8.jar.

• Reverts a 4.17-patch (db/sqlserver7394) update regarding how BIT and BOOLEAN column data type values are displayed. They now display as true or false (4.17 GA behavior now in snapsmrc523) rather than converting to 0 or 1 values (4.17-patch behavior).

Transform Snap Pack

• Sort: Enhances the sort feature to support specifying sort order at the field level. Adds two new fields, Sort Path and Sort Order, to the Sort paths property; renames the Sort order property to Sort order (Global).

• Group by N: Enhances the Group Size property to be expression enabled and removes the upper bound threshold (of 10000).

Metadata Snap Pack

• Enhances all the Snaps in this Snap Pack with the capability to create, delete, and update Snaplex directly inside the Pipeline.
  This feature facilitates administrative tasks if you are running your Pipelines on Groundplex. You can now create Snaplex programmatically by doing the following:

  1. Building a Pipeline with a Create Snap where you specify Snaplex as the Asset.

  2. Creating a Triggered Task in which the URL invokes the Pipeline.

  3. Sharing the URL with users in your Org so that when they run the Pipeline, the Snaplex is automatically created.

  Furthermore, you can use the Update Snap to update the node or logging properties in existing Snaplex.

• Pipelines configured with an on-premises Microsoft Dynamics CRM Account fails with Java 11 displaying this error – com.sun.xml.internal.messaging.saaj.soap.SAAJMetaFactoryImpl. Hence, you need to remain on Java 8 on the associated Snaplex for the said Pipelines to execute.

• A NullPointerException issue in the AWS SDK impacts the Binary, Redshift, Hadoop, Snowflake, and DynamoDB Snap Packs. Users leveraging AWS functionality and whose Snaplex has either a system configuration that uses an unauthenticated HTTP/HTTP proxy, or who have the same defined via Environment Variables are impacted. If a proxy was not used, or a proxy username and password was used, then customers are not affected. This issue was resolved in the 4.20 release.

• Preview output for Parquet Parser Snap does not match in Standard mode vis-a-vis the eXtreme mode, which displays the correct preview.

• File Writer and ZipFile Write Snaps do not create an output file when using the input from SAS Generator Snap configured with only the DELETE SAS permission. This is not the case when the target file exists.

The following 4.17 Snap Dot Release updates are now a part of the 4.18 release:

• eXtremeplex: Adds the ability to configure an eXtremeplex on Azure Databricks. You can now run your Spark jobs in eXtreme on Azure Databricks clusters in addition to AWS EMR clusters.

• Parquet Formatter Snap: Adds partition support. You can now partition the input tabular data by specifying the target partitioning keys.

• Redshift Select: Extracts data from your Redshift Databases. You can now build eXtreme Pipelines that query and pull data from your Redshift databases.

• Redshift Insert: Inserts data in your Redshift Databases. You can now build eXtreme Pipelines that write data to your Redshift databases.

• After an eXtremeplex terminates on Azure Databricks, the terminate event does not display on the Dashboard.

This section tracks the changes made during the iterative pushes to the UAT server and the GA release. The expected schedule is:

• UAT #1: Friday, July 26, 2019 (Release updates are published above)

• UAT #2: Friday, August 2, 2019

• GA: Saturday, August 10, 2019 (9 pm PT)

• Fixed an issue that allows you to create duplicate Proxy assets.

• Fixed an issue that prevents API consumers from searching for web applications on the Access and OAuth tabs of the API Manager.

• Fixed an issue where default value for SSO option is missing.

• Fixed an issue where Data Lineage display is not clearing previous results upon subsequent inquiries.

• Fixed an issue where clicking on Replace Current Pipe and Suggest Pipeline in Pipeline Recommendations results in a script error.

• Fixed an issue where the Pipeline Execution Logs for Azure Databricks does not display any information.

• Fixed an issue where the Developer Portal page does not work on Mozilla FireFox.

• Fixed an issue where a very long Proxy name breaks the Developer Portal landing page.

• Fixed an issue where disabling an Ultra Pipeline results in an empty error message.

• Fixed an issue where, if you cancel the deletion of a Pipeline in SnapLogic Designer, the pop-up closes, but the UI displays the busy icon interminably.

• Fixed an issue where, if you log in as an Admin viewing an Org of which you are not a member, the SnapLogic Dashboard does not display Snaplex instances correctly.

• Fixed an issue with Pipeline Recommendations where clicking Replace Current Pipe then deleting a Snap results in an error, and the Pipeline is not saved.

• Added support for DerbyDB when running with JRE 11.

• Fixed an issue with SSO redirect login.

• Fixed an issue with schema caching when running with older versions of Snaplex.

• Fixed multiple issues with Developer Portal related APIs.

• Fixed an issue with ORC Writer, Parquet Writer, HDFS Writer, and HDFS Zip File Writer Snaps wherein the Snaps throw an error and there is no output file for double slash after the container in the directory path.

• Fixed an issue with the HDFS Reader Snap where the Snap fails after rerouting error to the error view.

• Fixed an issue with the eXtreme Redshift Snaps pointing to incorrect documentation.

• Upgraded JRuby version to 9.1.17.0 that enables Script Snap to work on JDK 11 Snaplex.

• Improved the error message in Hadoop Snap Pack in the case of an incorrect dirpath format for ABFS protocol.

• Fixed an issue where adding a Snap on the canvas when the Suggested Pipeline panel is open results in a script error. 

• Fixed an issue where adding a Snap in a replaced suggested Pipeline and then saving it results in a script error.

• Fixed an issue where Snaps inserted in the middle of suggested Synthesis Pipelines does not have input/output views. 

• Fixed an issue where clicking a Pipeline in Suggested Pipelines panel displays an incorrect message.

• Fixed an issue with cluster monitoring in the eXtremeplex configuration.