On this page:
...
- Disabled Snap Functionality: Introduces a fundamental shift in the modes in which your Pipelines are executed. You can now disable a Snap, preventing it–and all downstream Snaps–from executing. This change takes a major complexity out of iterative development of Pipelines. If you have Pipelines with multiple branches, you can now test each branch in isolation without having to copy and import the branch into a new canvas.
- Triggered Task Updates: Introduces the following enhancements for running Pipelines as Triggered Tasks:
- You can access custom HTTP headers during execution through Pipeline parameters.
- Performance optimizations resulting in improved latency when triggering Tasks through On-premise and Local Override URLs, reducing latency.
- API Management Enhancements: The API Management layer is enhanced to handle at-scale management of APIs (Triggered tasks) configured to run on a Groundplex, as well as add support for OAuth2 authentication flow for APIs. APIM Proxies now support Tasks that are triggered from Groundplexes.
- Enhanced Support for Data Catalog: Enhances data catalog usability by enabling you to infer the Schema of your data using the JSON Formatter Snap. Previously, only metadata from Parquet-formatted files could be written to the Data Catalog. You can now use the following Snap pattern to populate the Data Catalog: JSON Formatter → File Writer → Catalog Insert.
- SFTP connection update for Snaps: Changed the default value for
maxSftpChannels
field to 2. - New Expressions: Enhance the SnapLogic Expressions Language by adding the following expressions:
...
Info |
---|
- Pipelines that start before a Snap update continue to run with the older version of the Snap. All Pipelines executed after a Snap update run with the new Snaps.
- For Ultra Pipelines, the currently running instances continue to run with the older Snap Packs. Editing and saving the task instance in Manager causes a rolling restart of the Ultra Pipeline instances, and the new Snap Packs get picked up.
- Customers using SQL Server with Windows authentication and SAP need to restart their Groundplexes Groundplex and CloudplexesCloudplex instances.
- New Snap Packs appear in the SnapLogic Designer only after all the JCCs in an org upgrade to the latest version.
|
Updated Snap Packs
Binary Snap Pack
- Enhanced the Binary Snap Pack to support SMB versions 2.0 and 3.0.
- Added two properties, Number of retries and Retry interval. Use these to manage retry attempts to the following Snaps in case of network failures:
Confluent Kafka Snap Pack and Hadoop Snap Pack
- The Snap Packs are tested and certified against CDH 6.1.
Database Snap Packs
- Fixed an issue with the Database Execute-type Snaps wherein the Snaps would send the input document to the output view even if the Pass through field is not selected in the Snap configuration. With this fix, the Snaps send the input document to the output view, under the key original, only if you select the Pass through field. The impacted Snaps are:
Hive Snap Pack
- Added a new authentication method, User ID and Password with SSL, for Hive SSL Accounts which allows SSL connections for valid user name and password credentials.
- Certified and tested the Snap Pack against CDH 6.1.
ML Analytics Snap Pack
- Profile: Added an optional second output view. When enabled, this outputs a graphical representation of the Snap's first output as a HTML file.
ML Core Snap Pack
- AutoML: Enhanced the AutoML Snap. You can now:
- Select algorithms to derive the top models.
- Input the best model generated by another AutoML Snap from a previous execution.
- View an interactive HTML report that contains statistics of up to 10 models.
- Clustering: New Snap that performs exploratory data analysis to find hidden patterns or groupings in data.
ML Data Preparation Snap Pack
- Feature Synthesis: New Snap that automatically creates features out of multiple datasets that share a one-to-one or one-to-many relationship with each other. Features are measurements of data points. For example, height, mean, mode, min, max, etc.
- Match: New Snap that identifies matched records across datasets that do not have a common key field.
NetSuite Snap Pack
- NetSuite is enforcing two-factor authentication (2FA) for credentials-based accounts and advises that all web-based integrations transition to token-based authentication. To support this transition, NetSuite Credentials account will be deprecated, and we recommend that you either create or switch to NetSuite Token account immediately, so that all SnapLogic Pipelines continue to work without any disruption.
REST Snap Pack
- Added support for OAuth 1.0 accounts, which enable you to connect to applications that require OAuth 1.0.
ServiceNow Snap Pack
- ServiceNow Insert and ServiceNow Query: Added Batch Size field that enables you to configure the number of documents that you want to process per batch. You can configure the Batch Size for Ultra Tasks as well.
...
Panel |
---|
Snap PacksSnap Pack | Update Date | Build | Updates |
---|
MongoDB | 7/29/2019 | db/mongo7665 | Fixed an issue with the MongoDB Find Snap wherein the Snap fails to query using UUIDs. | Flow | 7/22/2019 | flow7637 | Fixed an issue with the Data Validator Snap wherein the output fails to report all but one of the violations when there are multiple constraints of the Required type. | SQL Server | 7/18/2019 | MULTIPLE7479 | Fixed an issue with the SQL Server - Lookup Snap wherein it fails a UUID search. | PostgreSQL | 7/16/2019 | db/postgres7588 | Fixed an issue with tables sharing an overlapping column name wherein Pipeline execution fails due to the table collision. | Binary | 7/16/2019 | binary7589 | Fixed an issue with the File Reader Snap wherein SMB fails to provide multiple Snaps with concurrent access. | Salesforce | 7/15/2019 | salesforce7474 | Added Order by clause and Limit clause properties to the Salesforce Reader Snap to fix an issue wherein the Snap throws an error while fetching records. | Confluent Kafka | 07/12/2019 | confluentkafka7537 | Updated the following Snaps: - Confluent Kafka Consumer Snap
- Properties added: Max poll records, Acknowledge mode, Key deserializer, Value deserializer, Add 1 to offsets.
- Properties removed: Auto commit interval (msec), Standardize error output.
- Diagnostic fields added in the metadata object in the Snap's output:
- client_id: The unique ID assigned to a single Kafka consumer client instance. All documents written by a Consumer Snap during a single pipeline execution or validation will have the same value for this field.
- batch_size: The number of messages in the batch of messages that the current message came from. Note that “batch” isn’t Kafka terminology; we’re using it to mean the set of messages received from the broker in a single call to Kafka’s poll method.
- batch_index: The current batch number relative to a single consumer instance. This number starts at 0 for the first batch and is only incremented for batches which contain at least one message.
- record_index: The current record number relative to its batch. The first message in a batch has an index of 0; the last has an index of batch_size - 1.
- Confluent Kafka Acknowledge Snap
- Property added: Metadata path
- Confluent Kafka Producer Snap
- Properties added: Key serializer, Value serializer.
| Binary | 07/02/2019 | binary7487 | Fixed an issue with the File Writer Snap wherein the Overwrite File action for SMB files fails on subsequent executions. | Oracle | 06/26/2019 | db/oracle7459 | Fixed an issue with the Oracle Stored Procedure Snap wherein the Pipeline execution fails with an error when the input data type is CLOB. | Transform | 06/26/2019 | transform7431 | Added a new field, Ignore empty stream, to the Avro Formatter Snap that writes an empty array in the output in case of no input documents. | Redshift | 6/20/2019 | db/redshift7433 | Fixed an issue with the Redshift Bulk Load Snap wherein the Snap fails to copy the entire data from source to the Redshift table without any statements being aborted. | MongoDB | 6/18/2019 | db/mongo7427 | Fixed a Null Pointer Exception for old MongoDB accounts that did not have driver jars. | Anaplan | 6/18/2019 | Anaplan7422 | Fixed an issue with the Anaplan Read Snap wherein the Snap pulls archived and deleted models. | Transform | 6/17/2019 | Transform7417 | Added a new field, Format as canonical XML, to the XSLT Snap that enables canonical XML formatting. | All Snap Packs | 6/11/2019 | ALL7402 | Pushed automatic rebuild of the latest version of each Snap Pack to SnapLogic UAT and Elastic servers. | SQL Server | 6/10/2019 | db/sqlserver7394 | Fixed an issue wherein bit data types in the SQL Server - Select table convert to true or false instead of 0 or 1. | MySQL | 6/10/2019 | db/mysql7395 | Fixed an issue wherein bit data types in the MySQL - Select table convert to true or false instead of 0 or 1. | Snowflake | 6/10/2019 | db/snowflake7396 | Fixed an issue wherein bit data types in the Snowflake - Select table convert to true or false instead of 0 or 1. | Binary | 6/7/2019 | binary7381 | Fixed an issue with SMB accounts wherein login to the server fails if password contains a plus (+) sign. | Salesforce | 6/7/2019 | salesforce7352 | Fixed an issue with the Read and SOQL Snaps wherein Pipeline validation fails because of a dynamic account opening multiple file descriptors. | SumoLogic | 6/5/2019 | sumologic7369 | Fixed an issue with the Execute Search Job Snap wherein it fails to return the results correctly. | Binary | 6/4/2019 | binary7366 | Added support for multiple slashes as a prefix for SMB file URLs. | MySQL | 6/3/2019 | db/mysql7357 | Fixed an issue with the MySQL Execute snap wherein the Retry property for connection fails after the database connection is severed. | Snowflake | 5/31/2019 | db/snowflake7334 | Added AWS Server-Side Encryption support for AWS S3 and AWS KMS (Key Management Service) for Snowflake Bulk Load, Snowflake Bulk Upsert, and Snowflake Unload Snaps. | MongoDB | 5/24/2019 | db/mongo7331 | Fixed an issue with the MongoDB - Update Snap wherein the Snap converts all non-updated integer and float data types to string data type. | Google Spreadsheet | 5/15/2019 | google/spreadsheet7283 | Fixed an issue with the Worksheet Writer Snap wherein the No of valid records written field in the output document would count the header row. | Binary | 5/15/2019 | binary7280 | Added a new field, File delete action, to the File Delete Snap that handles missing target files. |
Update Date | Build | Updates |
---|
7/2/2019 | master-5492 Control Plane Only
| Enhanced SSO Login functionality to support additional authentication methods RequestedAuthnContext and RequestedAuthnContext Comparison at the Org-level. As an Org admin, you can configure these additional options for user logins across your Org. | 6/28/2019 | master-5508 - Patch 4
(Recommended)
| - Fixed an issue that can cause Pipeline Execute child pipelines to fail while loading accounts.
| 6/13/2019 | master-5472 - Patch 3 | - Fixed an issue that causes Groundplex triggered Pipelines comprising Pipeline Execute Snap with child Pipelines and performing an SLFS operation to fail with a 401 error.
- Fixed an issue that causes expression verification to generate warnings for the Pipeline suggest feature.
| 6/4/2019 | master-5396 - Patch 2 | Fixed a performance issue in Tasks triggered on a Groundplex, where the Pipeline uses the Pipeline Execute Snap to invoke a child Pipeline that references expression libraries. | 5/22/2019 | master-5365 - Patch 1 | - Added a retry handler to manage network failures during Pipeline information retrieval.
- Enhanced performance optimization for Groundplex Triggered Pipelines that use the Pipeline Execute Snap.
- Fixed an issue which causes some Pipelines, typically with Union Snaps, to hang during execution.
- Fixed an issue which causes some Pipeline creation times to show as
Invalid date .
| 5/20/2019 | N/A | - Fixed an issue causing Groundplex Triggered Task invocations to perform permission checks as the invoker instead of the Task owner.
- Fixed an issue causing Groundplex Triggered Tasks to fail if the CC user is present as a member of the organization.
- Fixed an issue causing runtime pushes to fail if a large number of Groundplex triggers are done concurrently.
|
UIUpdate Date | Build | Updates |
---|
6/13/2019 | N/A | - Fixed an issue with the Dependent Keys that causes the DataViz data preview to crash intermittently.
- Fixed an issue with the Visualization Key dropdown that does not let you scroll all the column values if they overflow the given dropdown size.
- Fixed issues with the Expression Builder for a Snap wherein you cannot undo an action; the cursor defaults to the beginning position while editing; and the scroll bar is missing.
- Fixed an issue with the Snap properties view that does not close when clicking the esc key on the keyboard.
| 5/20/2019 | N/A | - Fixed an issue where a script error appears when saving a Snap with a file input field (such as File Writer) in a Pipeline while at the same time another Snap with a file input field (like File Reader) is open in a different Pipeline.
- Fixed an issue where the JSON and Table View displays the new line character (\n) incorrectly in the Snap output preview.
- Fixed an issue with Snap recommendations when checking the compatibility of view type of the Mapper and Pipeline Execute Snaps because both Snaps support binary and document input/output.
|
|
...