...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
bgColor | lavender |
---|---|
titleColor | White |
titleBGColor | grey |
title | Contents |
In this Page
Table of Contents | ||
---|---|---|
|
Note |
---|
|
Before You Begin
You may need to clear your browser cache before you log into the latest SnapLogic Intelligent Integration Platform (IIP). See the applicable documentation for your browser:
You may see an Upgrade Notice informing that you will be logged out immediately to complete the update process. You may see this message a few times after a release, as the SnapLogic platform consists of multiple applications.
Note |
---|
We recommend that you upgrade to the latest browser version. |
Accounts and Platform Updates
Some accounts require fixed expiration times for their tokens. For example, Google accounts require that tokens are refreshed every hour. When the SnapLogic platform is down for an update, scheduled refreshes are not executed, and Snaps using these accounts may fail when used immediately after an update. To prevent this, refresh your accounts before the scheduled downtime. If the platform is down for longer than an hour, you may need to refresh some accounts manually once the platform is back online.
Platform Enhancements
General
- API Management: Enhanced API Management, an integrated solution for managing APIs within the SnapLogic IIP. API Management enables you to publish your APIs as a Proxy using a four-step wizard. Manage a range of API Policies, including Basic Authentication, IP Restriction, Rate Limiting, Request and Response Transformers, and Cross Origin Sharing (CORs). API Management also offers analytics such as historical API usage and performance metrics, as well as the ability to view your APIs in the Open API Specification format.
- Resumable Pipelines: Introducing the ability for pipelines to be suspended when there is an error while communicating with an endpoint. You can resume Pipeline execution when the target endpoint is available again. In the first phase of this subscription feature, pipelines are suspended when an error occurs, so that the state of the execution is saved onto the Snaplex nodes. When execution resumes, the saved execution state is loaded, and execution continues from where it paused. Previously, these documents would have been lost, and you would have had to re-execute the Pipeline. When a Resumable Pipeline is suspended, you can resume the pipeline on the SnapLogic Dashboard. Support in this release extends to application integration only. Bulk loads or Snaps that run batch jobs are currently not supported.
- Data Catalog: Enhances Table Assets in the Data Catalog with the functionality to display and delete tables and table partitions. This enhancement also delivers the capability to query information from the Data Catalog, simplifying the task of managing source metadata within the SnapLogic Platform.
- IP Whitelisting of Ultra Tasks on the Cloudplex: Updated the IP Whitelist feature in SnapLogic Manager Settings, allowing you to restrict the IP Addresses used to call Ultra Tasks that run on a Cloudplex. You can also apply the same restrictions to Triggered and Ultra Tasks that run on a Groundplex. For details, see Access Control for Triggered and Ultra Tasks.
- Snaplex Versioning API: Added four new APIs that enable you to determine the version of your Snaplex, obtain the latest Snaplex package version available, and update your Snaplex to either the latest version or a version of your preference.
- Snaplex Alerts: An alert is displayed in the SnapLogic Dashboard (Health wall) if more than one node uses the same jetty certificate or key. It includes the names of all nodes sharing the certificate/key.
UI Enhancements
Designer
Introduced new color-coding for the Resumable Pipeline feature. Snaps in suspended Pipelines are color-coded orange to indicate where the documents stopped processing.
When you resume Pipeline execution and all Snaps execute successfully, the entire Pipeline turns green.
Manager
- Table Assets: Enhanced Table Assets in SnapLogic Manager to display the table partitions in your source data. For each entry, clicking the Metadata icon displays custom metadata, and clicking the Schema icon displays the schema. Furthermore, as you scroll through the partitions, you can perform searches with the same query functionality used in the Catalog Query Snap.
- Proxy Assets: Added a workflow for publishing APIs via a Proxy wizard in SnapLogic Manager. In addition, you can search your Assets in Manager for Proxies and view detailed metrics about API usage and latency.
- IP Whitelisting: Updated the dialog to include whitelisting IP addresses for Ultra Tasks on a Cloudplex and added an option for applying the same IP address restrictions to Triggered and Ultra Tasks on a Groundplex.
Dashboard
You can use the Dashboard to check status of your Resumable Pipeline. You can view Pipeline status history and resume a suspended Pipeline using the new Resume icon ().
Snap Enhancements
Info |
---|
|
New Snap Pack
SnapLogic Data Science
ML Natural Language Processing Snap Pack:
- Tokenizer: Convert sentences into an array of tokens. A token, in the context of the ML Natural Language Processing Snap Pack, can be a word and/or a special character. In order to perform Natural Language Processing (NLP) operations with other Snaps in this Snap Pack, an array of tokens is required. The Tokenizer Snap uses Apache OpenNLP Library.
- Common Words: Identify the most common words in the input dataset and compute the frequency with which they occur. This Snap also offers you the ability to specify the number of most common words that you want to include in the output.
- Bag of Words: Vectorize sentences into a set of numeric fields. Each numeric field represents the frequency of every word in each sentence.
Added documentation on how to deploy Machine Learning models as REST APIs in SnapLogic.
New Snaps in Existing Snap Packs
- Salesforce Publisher: Publish Salesforce platform event records to a given event custom sObject (Salesforce Object).
- Salesforce Subscriber: Subscribe to Salesforce platform event records for a given event custom sObject.
SnapLogic Data Science
- Auto ML: Automate the process of selecting machine learning algorithms and tuning hyperparameters. This Snap gives the best predictive model within the specified time limit.
ML Data Preparation Snap Pack:
- Principal Component Analysis: Perform principal component analysis (PCA) on numeric fields (columns) to reduce dimensions of the dataset.
Updated Snap Packs
Core
- Binary Snap Pack:
- Added a new property, Blob endpoint, which enables you to specify the Azure Blob Storage endpoint that you want to use with an Azure Storage account.
- Added a new property, Only Output on Change, in the File Poller Snap. This property helps avoid redundancy by not displaying the same matching file in every polling result, unless the file is changed.
- Data Catalog Snap Pack: Added the Catalog Delete Snap to remove tables and table partitions from the Data Catalog.
Data
- Hadoop Snap Pack: Added a new property, Output for each file written, to handle multiple binary input data in the HDFS Writer Snap.
- Snowflake Snap Pack:
- Added the ability to use SnapLogic to securely connect to and query a Snowflake instance using Azure Blob as its storage layer. See Snowflake Account documentation for details.
- Added support for snowflake JDBC JAR version 3.6.17. See Snowflake Account documentation for details.
- Updated the Snowflake Unload, Bulk Load, and Bulk Upsert Snaps to enable SnapLogic users to successfully connect to a Snowflake instance to query, bulk load, and unload data from Azure Blob storage.
Enterprise
Netsuite Snap Pack: The Target Schema of the Mapper Snap now displays custom fields by their Display Names in Pipelines that use the NetSuite Create, Update, Upsert, Search, Async Upsert, or Async Search Snaps.
Note Custom fields are not displayed in the updated NetSuite Snaps. They are visible only for Snaps where you have configured custom fields with SnapLogic 4.15 or earlier releases.
With the updated NetSuite Snaps, you must connect a Mapper Snap as an upstream Snap to map custom fields.- Workday Prism Analytics Snap Pack: Updated the name of the Workday Prism Snap Pack to Workday Prism Analytics Snap Pack.
Flow
- Pipeline Execute: Added the capability to select either document (previously supported) or binary data (new) for your input and output Views.
JWT Snap Pack
JWT Snap Pack: Added support for asymmetric keys. You now have more security options for hashing algorithms used to generate the signature of the token in the JWT Generate and JWT Validate Snaps.
Known Issues
- While authorizing accounts for the Google Spreadsheet Snap Pack, force approval prompts you to request a new refresh token.
- In the SQL Server Snap Pack, Pipeline execution fails whenever a value is set in the Limit offset property of the SQL Server Select Snap.
- For a Salesforce Read or SOQL Snap using the REST API, certain network failures while reading a REST response may result in a socket timeout exception that will not retire.
- For a Salesforce (Platform Events) Subscriber Snap, retry attempts are not logged, and currently retries are attempted only for authentication errors.
eXtreme Big Data Enhancements
General
- Hybrid Instances: Enhanced eXtremplex settings with the capability to choose a combination of On Demand and Spot instances for the market pricing of your cluster resources. You can now determine how to allocate your cluster resources across EMR nodes to initiate autoscaling, while ensuring that your eXtreme Pipelines run to completion if the market costs supersede your bid. EMR Task nodes are now supported for starting Spot market node/instances.
- Volume size: Added a property in the eXtremeplex settings form where you can enter the capacity size of the cluster node (default is 500 GB). You can now size your node capacity for resource-intensive eXtreme Pipeline runs so that the cluster does not fail to boot.
- eXtremeplex version: Added the capability to determine the eXtremeplex version that you want to use to run eXtreme Pipelines to allow legacy Pipelines to run on older eXtremeplex versions.
- Added support to capture statistics of the data processed in eXtreme Pipelines. This is seen as total input and output data in Pipeline Execution Statistics > Extra Details tab.
New Snaps in Spark 2.x Snap Pack
- PySpark: Upload your existing PySpark scripts as eXtreme Pipelines.
- JAR Submit: Upload your existing Spark Java JAR programs as eXtreme Pipelines.
- Snowflake Select and Snowflake Insert: Extract and insert data from and to a database in your Snowflake Data Warehouse.
Known Issues
SnapLogic does not support the instance type m5a.4xlarge in the EMR-5.14.0 release. Creating an eXtremeplex using m5a.4xlarge results in the following error message:
Instance type m5a.4xlarge not supported for release emr-5.14.0
.- Executing multiple Pipelines simultaneously might result in the following error message:
Unable to acquire lease on /extreme_qa/shared/automationEplex after 10 tries. Giving up. Fix these errors
. This error occurs when more than one cluster is started at the same time. When executing a Pipeline containing Parquet Snaps with LZO compressed data on a Hadooplex, the Pipeline might stop and result in the following error message:
Failure: Failed to provide preview data, Reason: Server Error.
Try validating Pipeline again.- When you execute an eXtreme Pipeline containing a PySpark or JAR Submit Snap, the execution statistics do not display the ruuid (runtime identifier).
- If you inadvertently execute an eXtreme Pipeline in Standard mode on a Cloudplex or Groundplex, you do not receive an error message, even though this operation is not supported.
- When you view Submission time and Completion time details in Pipeline Execution Statistics, the time is displayed in UTC format instead of local time.
UAT Delta
Panel |
---|
This section tracks the changes made during the iterative pushes to the UAT server and the GA release. The expected schedule is:
UAT #2 Updates Platform
UI
Big Data
UAT #3 Updates Platform
UI
Big Data
GA Updates UI
|
4.16 Dot Releases
Panel | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SnapLogic dot releases help optimize and continuously improve the platform. This dot release section documents all customer-impacting updates across the SnapLogic platform. Platform
UI
Snap Packs
For information on updating the Snap Packs, refer to How to upgrade to a new Snap Pack version. |