In this Page
- Per the SnapLogic Release Process, all the remaining Snaplexes across Orgs are upgraded to the 4.16 release at 9 pm PDT on March 23, 2019.
- This release also includes the patches made to SnapLogic after the 4.15 GA release, as listed in the 4.15 Dot Releases page.
Before You Begin
You may need to clear your browser cache before you log into the latest SnapLogic Intelligent Integration Platform (IIP). See the applicable documentation for your browser:
You may see an Upgrade Notice informing that you will be logged out immediately to complete the update process. You may see this message a few times after a release, as the SnapLogic platform consists of multiple applications.
We recommend that you upgrade to the latest browser version.
Accounts and Platform Updates
Some accounts require fixed expiration times for their tokens. For example, Google accounts require that tokens are refreshed every hour. When the SnapLogic platform is down for an update, scheduled refreshes are not executed, and Snaps using these accounts may fail when used immediately after an update. To prevent this, refresh your accounts before the scheduled downtime. If the platform is down for longer than an hour, you may need to refresh some accounts manually once the platform is back online.
- API Management: Enhanced API Management, an integrated solution for managing APIs within the SnapLogic IIP. API Management enables you to publish your APIs as a Proxy using a four-step wizard. Manage a range of API Policies, including Basic Authentication, IP Restriction, Rate Limiting, Request and Response Transformers, and Cross Origin Sharing (CORs). API Management also offers analytics such as historical API usage and performance metrics, as well as the ability to view your APIs in the Open API Specification format.
- Resumable Pipelines: Introducing the ability for pipelines to be suspended when there is an error while communicating with an endpoint. You can resume Pipeline execution when the target endpoint is available again. In the first phase of this subscription feature, pipelines are suspended when an error occurs, so that the state of the execution is saved onto the Snaplex nodes. When execution resumes, the saved execution state is loaded, and execution continues from where it paused. Previously, these documents would have been lost, and you would have had to re-execute the Pipeline. When a Resumable Pipeline is suspended, you can resume the pipeline on the SnapLogic Dashboard. Support in this release extends to application integration only. Bulk loads or Snaps that run batch jobs are currently not supported.
- Data Catalog: Enhances Table Assets in the Data Catalog with the functionality to display and delete tables and table partitions. This enhancement also delivers the capability to query information from the Data Catalog, simplifying the task of managing source metadata within the SnapLogic Platform.
- IP Whitelisting of Ultra Tasks on the Cloudplex: Updated the IP Whitelist feature in SnapLogic Manager Settings, allowing you to restrict the IP Addresses used to call Ultra Tasks that run on a Cloudplex. You can also apply the same restrictions to Triggered and Ultra Tasks that run on a Groundplex. For details, see Access Control for Triggered and Ultra Tasks.
- Snaplex Versioning API: Added four new APIs that enable you to determine the version of your Snaplex, obtain the latest Snaplex package version available, and update your Snaplex to either the latest version or a version of your preference.
- Snaplex Alerts: An alert is displayed in the SnapLogic Dashboard (Health wall) if more than one node uses the same jetty certificate or key. It includes the names of all nodes sharing the certificate/key.
Introduced new color-coding for the Resumable Pipeline feature. Snaps in suspended Pipelines are color-coded orange to indicate where the documents stopped processing.
When you resume Pipeline execution and all Snaps execute successfully, the entire Pipeline turns green.
- Table Assets: Enhanced Table Assets in SnapLogic Manager to display the table partitions in your source data. For each entry, clicking the Metadata icon displays custom metadata, and clicking the Schema icon displays the schema. Furthermore, as you scroll through the partitions, you can perform searches with the same query functionality used in the Catalog Query Snap.
- Proxy Assets: Added a workflow for publishing APIs via a Proxy wizard in SnapLogic Manager. In addition, you can search your Assets in Manager for Proxies and view detailed metrics about API usage and latency.
- IP Whitelisting: Updated the dialog to include whitelisting IP addresses for Ultra Tasks on a Cloudplex and added an option for applying the same IP address restrictions to Triggered and Ultra Tasks on a Groundplex.
You can use the Dashboard to check status of your Resumable Pipeline. You can view Pipeline status history and resume a suspended Pipeline using the new Resume icon ( ).
- Pipelines that are already started before a Snap update will continue to run with the older version of the Snaps. All Pipelines executed after a Snap update run with the new Snaps
- For Ultra Pipelines, the currently running instances will continue to run with the older Snap packs. Editing and saving the task instance in Manager will cause a rolling restart of the Ultra Pipeline instances and the new Snap Packs will get picked up.
- Customers using SQL Server with Windows authentication and SAP will need to restart their Groundplex and Cloudplex instances.
- New Snap Packs are displayed in the SnapLogic Designer only after all the JCCs in an org are upgraded to the latest version.
New Snap Pack
SnapLogic Data Science
ML Natural Language Processing Snap Pack:
- Tokenizer: Convert sentences into an array of tokens. A token, in the context of the ML Natural Language Processing Snap Pack, can be a word and/or a special character. In order to perform Natural Language Processing (NLP) operations with other Snaps in this Snap Pack, an array of tokens is required. The Tokenizer Snap uses Apache OpenNLP Library.
- Common Words: Identify the most common words in the input dataset and compute the frequency with which they occur. This Snap also offers you the ability to specify the number of most common words that you want to include in the output.
- Bag of Words: Vectorize sentences into a set of numeric fields. Each numeric field represents the frequency of every word in each sentence.
Added documentation on how to deploy Machine Learning models as REST APIs in SnapLogic.
New Snaps in Existing Snap Packs
Salesforce Snap Pack:
- Salesforce Publisher: Publish Salesforce platform event records to a given event custom sObject (Salesforce Object).
- Salesforce Subscriber: Subscribe to Salesforce platform event records for a given event custom sObject.
SnapLogic Data Science
ML Core Snap Pack:
- Auto ML: Automate the process of selecting machine learning algorithms and tuning hyperparameters. This Snap gives the best predictive model within the specified time limit.
ML Data Preparation Snap Pack:
Updated Snap Packs
- Binary Snap Pack:
- Added a new property, Blob endpoint, which enables you to specify the Azure Blob Storage endpoint that you want to use with an Azure Storage account.
- Added a new property, Only Output on Change, in the File Poller Snap. This property helps avoid redundancy by not displaying the same matching file in every polling result, unless the file is changed.
- Data Catalog Snap Pack: Added the Catalog Delete Snap to remove tables and table partitions from the Data Catalog.
- Hadoop Snap Pack: Added a new property, Output for each file written, to handle multiple binary input data in the HDFS Writer Snap.
- Snowflake Snap Pack:
- Added the ability to use SnapLogic to securely connect to and query a Snowflake instance using Azure Blob as its storage layer. See Snowflake Account documentation for details.
- Added support for snowflake JDBC JAR version 3.6.17. See Snowflake Account documentation for details.
- Updated the Snowflake Unload, Bulk Load, and Bulk Upsert Snaps to enable SnapLogic users to successfully connect to a Snowflake instance to query, bulk load, and unload data from Azure Blob storage.
Netsuite Snap Pack: The Target Schema of the Mapper Snap now displays custom fields by their Display Names in Pipelines that use the NetSuite Create, Update, Upsert, Search, Async Upsert, or Async Search Snaps.
Custom fields are not displayed in the updated NetSuite Snaps. They are visible only for Snaps where you have configured custom fields with SnapLogic 4.15 or earlier releases.
With the updated NetSuite Snaps, you must connect a Mapper Snap as an upstream Snap to map custom fields.
- Workday Prism Analytics Snap Pack: Updated the name of the Workday Prism Snap Pack to Workday Prism Analytics Snap Pack.
- Pipeline Execute: Added the capability to select either document (previously supported) or binary data (new) for your input and output Views.
JWT Snap Pack
- While authorizing accounts for the Google Spreadsheet Snap Pack, force approval prompts you to request a new refresh token.
- In the SQL Server Snap Pack, Pipeline execution fails whenever a value is set in the Limit offset property of the SQL Server Select Snap.
- For a Salesforce Read or SOQL Snap using the REST API, certain network failures while reading a REST response may result in a socket timeout exception that will not retire.
- For a Salesforce (Platform Events) Subscriber Snap, retry attempts are not logged, and currently retries are attempted only for authentication errors.
eXtreme Big Data Enhancements
- Hybrid Instances: Enhanced eXtremplex settings with the capability to choose a combination of On Demand and Spot instances for the market pricing of your cluster resources. You can now determine how to allocate your cluster resources across EMR nodes to initiate autoscaling, while ensuring that your eXtreme Pipelines run to completion if the market costs supersede your bid. EMR Task nodes are now supported for starting Spot market node/instances.
- Volume size: Added a property in the eXtremeplex settings form where you can enter the capacity size of the cluster node (default is 500 GB). You can now size your node capacity for resource-intensive eXtreme Pipeline runs so that the cluster does not fail to boot.
- eXtremeplex version: Added the capability to determine the eXtremeplex version that you want to use to run eXtreme Pipelines to allow legacy Pipelines to run on older eXtremeplex versions.
- Added support to capture statistics of the data processed in eXtreme Pipelines. This is seen as total input and output data in Pipeline Execution Statistics > Extra Details tab.
New Snaps in Spark 2.x Snap Pack
- PySpark: Upload your existing PySpark scripts as eXtreme Pipelines.
- JAR Submit: Upload your existing Spark Java JAR programs as eXtreme Pipelines.
- Snowflake Select and Snowflake Insert: Extract and insert data from and to a database in your Snowflake Data Warehouse.
SnapLogic does not support the instance type m5a.4xlarge in the EMR-5.14.0 release. Creating an eXtremeplex using m5a.4xlarge results in the following error message:
Instance type m5a.4xlarge not supported for release emr-5.14.0.
- Executing multiple Pipelines simultaneously might result in the following error message:
Unable to acquire lease on /extreme_qa/shared/automationEplex after 10 tries. Giving up. Fix these errors. This error occurs when more than one cluster is started at the same time.
When executing a Pipeline containing Parquet Snaps with LZO compressed data on a Hadooplex, the Pipeline might stop and result in the following error message:
Failure: Failed to provide preview data, Reason: Server Error.Try validating Pipeline again.
- When you execute an eXtreme Pipeline containing a PySpark or JAR Submit Snap, the execution statistics do not display the ruuid (runtime identifier).
- If you inadvertently execute an eXtreme Pipeline in Standard mode on a Cloudplex or Groundplex, you do not receive an error message, even though this operation is not supported.
- When you view Submission time and Completion time details in Pipeline Execution Statistics, the time is displayed in UTC format instead of local time.
This section tracks the changes made during the iterative pushes to the UAT server and the GA release. The expected schedule is:
- UAT #1, January 18, 2019 (Release updates are published above)
- UAT #2, January 25, 2019
- UAT #3, February 01, 2019
- GA, February 16, 2019 (9 pm PST)
UAT #2 Updates
- Fixed an issue with error handling for locked user accounts.
- Fixed an issue with expression caching and with the Date.toLocaleDateString function evaluation.
- Fixed an issue with state cleanup during a Pipeline abort.
- Fixed issues with API proxy creation functionality.
- Fixed a script error issue when importing an empty file using the Import file option present in Snaps such as the Script Snap, CSV Generator Snap, and XML Generator Snap, results in a script error.
- Fixed an issue where creating a Proxy and clicking Try It with an invalid JSON results in the following error:
Uncaught SyntaxError: Unexpected token ] in JSON.
- Fixed error messages in API Management.
- Fixed text in Dialog for IP Whitelist in Manager > Settings.
- Fixed an issue with Table Assets where clicking on an asset results in an incorrect display of the UI.
- Fixed an issue where resizing the UI window removes the header from view.
- Fixed an issue where the Pipeline execution time that displays on the UI for eXtreme Pipelines is the driver execution time and not the total time from the point when the Pipeline triggers.
- Fixed an issue where eXtreme Snowflake Snaps are not working when other Spark SQL 2.x Snaps are present in the same Pipeline.
UAT #3 Updates
- Fixed issue with error reporting during Pipeline abort.
- Fixed issue with Pipeline cleanup related functionality.
- Raised timeout for preparing a triggered Pipeline on a Groundplex with a slow network.
- Fixed an issue where clicking on the TRUSTe image on the Login page results in the following error message:
This site is NOT a member of the TRUSTe Certification program.
- Fixed an issue where the Mapper Snap displays incorrect schema after validation.
- Fixed an issue where the Create Org dialog is not displaying the full pop up menu, requiring the user to resize the window.
- Fixed an issue with the Data Catalog where some values could be incorrectly inserted into field on the Data Catalog Snaps, breaking the Table Asset.
- Fixed an issue where an offset between UTC and local time are yielding inaccurate Proxy statistics.
- Fixed an issue with State Transition details for Ultra Pipelines are misaligned.
- Fixed an issue where the failed login error message incorrectly appears.
- Fixed an issue where copying an eXtremeplex results in the following error message:
Notification: xxx is not of type value. Notification: xxx value must be of type object.
- Fixed an issue in API Management, wherein the UI displays time in the user's local time zone, instead of UTC.
- Removed Total Input Bytes statistics for Spark Pipelines, since it only applies for eXtreme Pipelines.
- Fixed an issue with
group1 private Snap Pack that displays a script error upon clicking a Snap, instead of opening the Snap Infobox.
4.16 Dot Releases
SnapLogic dot releases help optimize and continuously improve the platform. This dot release section documents all customer-impacting updates across the SnapLogic platform.
|NA||4/16/2019||Fixed an issue in the Control Plane that caused the linkage of existing Tasks with Pipelines to fail when the associated Project undergoes multiple migrations.|
- Fixed an issue where switching Orgs while working in Chrome results in a Script Error message.
- Fixed an issue so that you can navigate by month when searching for Assets in SnapLogic Manager.
- Fixed an issue where selecting Auto-Scaling on the Advanced tab of the eXtremeplex form results in an error.
|Snap Pack||Update Date||Build||Updates|
|MS Dynamics 365 for Sales||5/1/2019|
Dynamics 365 for Sales Read Snap now supports custom object types.
|Fixed an issue in the Azure SQL Bulk Extract Snap wherein the Snap fails to process all the metadata information of the input table and schema.|
|Fixed an issue wherein the Spreadsheets Browser Snap fails if a spreadsheet name contains / or : in Windows plex.|
|Added two new properties, Number of retries and Retry interval, to Execute, Insert, Select, and Update Snaps that enables you to handle retry attempts during a connection failure.|
|MYSQL||Added two new properties, Number of retries and Retry interval, to Delete, Insert, Select, Execute, Merge, Update, and MutliExecute Snaps that enables you to handle retry attempts during a connection failure.|
|Oracle||Added two new properties, Number of retries and Retry interval, to Delete, Insert, Select, Execute, Merge, and Update Snaps that enables you to handle retry attempts during a connection failure.|
|Fixed an issue with the Confluent Kafka Producer Snap wherein the Snap fails to produce the upstream Snap's input schema for Partition Number property in the output preview.|
|Fixed an issue with the Email Delete Snap wherein the Snap fails to delete emails with multiple input documents.|
|Fixed an issue with the File Writer Snap wherein the Snap writes FTPS files partially. Two new global properties, ftpsDelayBeforeClosing and ftpDelayBeforeClosing, enable you to add delays to the FTP file protocol to handle the partial write.|
|Fixed an issue in SAP HANA Update and Insert Snaps wherein time data type was not getting passed if a table name and column name were similar in multiple schemas.|
|Fixed an issue with the XSLT Snap failure by enhancing the Saxon version.|
|Fixed an issue with the SAP HANA - Delete Snap wherein the Snap was unable to delete a data if the delete condition was not selected or if the condition was a static value. |
Enhanced the Tableau REST Snap to accept the append_file_upload REST operation which provides more flexibility while publishing datasource/workbook.
|Enhanced the MongoDB Find Snap to support Decimal128 data type so that Decimal128 values are rendered as NumberDecimal in the Mongo shell.|
|Fixed an issue with paging variable toggle in Workday Read Snap to produce correct preview data.|
|Fixed an issue of slow performance in SQL Server Snaps while using SQL Server Dynamic account type.|
Added a new property, Blob endpoint for Binary Accounts, which enables you to specify the Azure Blob Storage endpoint that you want to use with an Azure Storage account.
- Added a new property, Escape special characters, to the XML Generator Snap that enables you to escape XML special characters in template variable values.
- Added a new property, Header size error policy, to the CSV Formatter and CSV Parser Snaps. The property enables you to handle header size errors.
- Deprecated the NetSuite Credential account type.
- Fixed an issue with running multiple Pipelines by lazy-fetching custom fields metadata.
|Fixed an issue with the SOAP Execute Snap wherein SLDB protocols were not being supported.|
|ServiceNow Snaps will not support parsing logic for JSON version. All JSON versions must be replaced with JSON2.|
Added support for file format options for input data from upstream Snaps, to the Snowflake Bulk Load Snap.
|Workday Prism Analytics||3/8/2019|
|Added a new property, Append, to the Bulk Load Snap that lets you add data to an existing dataset.|
Added a new property, Session parameters, in the Oracle Insert Snap to enable the use of National Language Support (NLS) parameters.
|Fixed an issue with the Cassandra Execute Snap wherein output documents were not produced on selecting the Pass through property.|
|Certified Confluent Platform version 5.x. This was due to Confluent Platform not supporting version 3.2.0 after March 2, 2019. The Snap Pack still supports 3.2.0 to ensure backward compatibility.|
Added two new properties, Number of retries and Retry interval, to the Salesforce Read, SOQL, Publisher, and Subscriber Snaps. These properties let you handle retry attempts and intervals in case of a network failure.
|Fixed an issue with the XML Parser Snap wherein XSD with annotations are incorrectly interpreted.|
|Fixed an issue with the Reltio Generic Execute Snap wherein response codes are handled incorrectly.|
Fixed an issue with the Lookup Snap passing data simultaneously to output and error views when some values contain spaces at the end.
- Added a new property, Buffer size (MB), to the Snowflake Bulk Load Snap. Buffer size lets you specify the size limit of each buffer when writing to external staging systems such as S3.
- Fixed an issue with the Lookup Snap passing data simultaneously to output and error views when some values contain spaces at the end.
|Fixed an issue with the Workday Read Snap not logging SOAP calls.|
For information on updating the Snap Packs, refer to How to upgrade to a new Snap Pack version.