Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

On this page:

...

  • Disabled Snap Functionality: Introduces a fundamental shift in the modes in which your Pipelines are executed. You can now disable a Snap, preventing it–and all downstream Snaps–from executing. This change takes a major complexity out of iterative development of Pipelines. If you have Pipelines with multiple branches, you can now test each branch in isolation without having to copy and import the branch into a new canvas.



  • Triggered Task Updates: Introduces the following enhancements for running Pipelines as Triggered Tasks:
    • You can access custom HTTP headers during execution through Pipeline parameters.
    • Performance optimizations resulting in improved latency when triggering Tasks through On-premise and Local Override URLs, reducing latency.
  • API Management EnhancementsThe API Management layer is enhanced to handle at-scale management of APIs (Triggered tasks) configured to run on a Groundplex, as well as add support for OAuth2 authentication flow for APIs. APIM Proxies now support Tasks that are triggered from Groundplexes.
  • Enhanced Support for Data Catalog: Enhances data catalog usability by enabling you to infer the Schema of your data using the JSON Formatter Snap. Previously, only metadata from Parquet-formatted files could be written to the Data Catalog. You can now use the following Snap pattern to populate the Data Catalog: JSON Formatter → File Writer → Catalog Insert.
  • SFTP connection update for Snaps: Changed the default value for maxSftpChannels field to 2.
  • New Expressions: Enhance the SnapLogic Expressions Language by adding the following expressions:

...

Info
  • Pipelines that start before a Snap update continue to run with the older version of the Snap. All Pipelines executed after a Snap update run with the new Snaps.
  • For Ultra Pipelines, the currently running instances continue to run with the older Snap Packs. Editing and saving the task instance in Manager causes a rolling restart of the Ultra Pipeline instances, and the new Snap Packs get picked up.
  • Customers using SQL Server with Windows authentication and SAP need to restart their Groundplexes Groundplex and CloudplexesCloudplex instances.
  • New Snap Packs appear in the SnapLogic Designer only after all the JCCs in an org upgrade to the latest version.

Updated Snap Packs

Binary Snap Pack

Confluent Kafka Snap Pack and Hadoop Snap Pack

  • The Snap Packs are tested and certified against CDH 6.1.

Database Snap Packs

Hive Snap Pack

  • Added a new authentication method, User ID and Password with SSL, for Hive SSL Accounts which allows SSL connections for valid user name and password credentials.
  • Certified and tested the Snap Pack against CDH 6.1.

ML Analytics Snap Pack

  • ProfileAdded an optional second output view. When enabled, this outputs a graphical representation of the Snap's first output as a HTML file.

ML Core Snap Pack

  • AutoML: Enhanced the AutoML Snap. You can now:
    • Select algorithms to derive the top models.
    • Input the best model generated by another AutoML Snap from a previous execution.
    • View an interactive HTML report that contains statistics of up to 10 models.
  • Clustering: New Snap that performs exploratory data analysis to find hidden patterns or groupings in data.

ML Data Preparation Snap Pack

  • Feature Synthesis: New Snap that automatically creates features out of multiple datasets that share a one-to-one or one-to-many relationship with each other. Features are measurements of data points. For example, height, mean, mode, min, max, etc.
  • Match: New Snap that identifies matched records across datasets that do not have a common key field.

NetSuite Snap Pack

  • NetSuite is enforcing two-factor authentication (2FA) for credentials-based accounts and advises that all web-based integrations transition to token-based authentication. To support this transition, NetSuite Credentials account will be deprecated, and we recommend that you either create or switch to NetSuite Token account immediately, so that all SnapLogic Pipelines continue to work without any disruption.

REST Snap Pack

  • Added support for OAuth 1.0 accounts, which enable you to connect to applications that require OAuth 1.0.

ServiceNow Snap Pack 

  • ServiceNow Insert and ServiceNow Query: Added Batch Size field that enables you to configure the number of documents that you want to process per batch. You can configure the Batch Size for Ultra Tasks as well.

...

Panel

Snap Packs

Snap PackUpdate DateBuildUpdates
MongoDB7/29/2019db/mongo7665Fixed an issue with the MongoDB Find Snap wherein the Snap fails to query using UUIDs.
Flow7/22/2019flow7637Fixed an issue with the Data Validator Snap wherein the output fails to report all but one of the violations when there are multiple constraints of the Required type.
SQL Server7/18/2019MULTIPLE7479

Fixed an issue with the SQL Server - Lookup Snap wherein it fails a UUID search.

PostgreSQL7/16/2019db/postgres7588Fixed an issue with tables sharing an overlapping column name wherein Pipeline execution fails due to the table collision.
Binary7/16/2019binary7589

Fixed an issue with the File Reader Snap wherein SMB fails to provide multiple Snaps with concurrent access.

Salesforce7/15/2019salesforce7474

Added Order by clause and Limit clause properties to the Salesforce Reader Snap to fix an issue wherein the Snap throws an error while fetching records.

Confluent Kafka07/12/2019confluentkafka7537

Updated the following Snaps:

  • Confluent Kafka Consumer Snap
    • Properties added: Max poll records, Acknowledge mode, Key deserializer, Value deserializer, Add 1 to offsets.
    • Properties removed: Auto commit interval (msec), Standardize error output.
    • Diagnostic fields added in the metadata object in the Snap's output:
      • client_id:  The unique ID assigned to a single Kafka consumer client instance. All documents written by a Consumer Snap during a single pipeline execution or validation will have the same value for this field.
      • batch_size: The number of messages in the batch of messages that the current message came from. Note that “batch” isn’t Kafka terminology; we’re using it to mean the set of messages received from the broker in a single call to Kafka’s poll method.
      • batch_index: The current batch number relative to a single consumer instance.  This number starts at 0 for the first batch and is only incremented for batches which contain at least one message.
      • record_index: The current record number relative to its batch.  The first message in a batch has an index of 0; the last has an index of batch_size - 1.
  • Confluent Kafka Acknowledge Snap
    • Property added: Metadata path
  • Confluent Kafka Producer Snap
    • Properties added: Key serializer, Value serializer.
Binary07/02/2019binary7487Fixed an issue with the File Writer Snap wherein the Overwrite File action for SMB files fails on subsequent executions.
Oracle06/26/2019db/oracle7459Fixed an issue with the Oracle Stored Procedure Snap wherein the Pipeline execution fails with an error when the input data type is CLOB.
Transform06/26/2019transform7431

Added a new field, Ignore empty stream, to the Avro Formatter Snap that writes an empty array in the output in case of no input documents.

Redshift6/20/2019db/redshift7433Fixed an issue with the Redshift Bulk Load Snap wherein the Snap fails to copy the entire data from source to the Redshift table without any statements being aborted.
MongoDB6/18/2019db/mongo7427Fixed a Null Pointer Exception for old MongoDB accounts that did not have driver jars.
Anaplan6/18/2019Anaplan7422Fixed an issue with the Anaplan Read Snap wherein the Snap pulls archived and deleted models.
Transform6/17/2019Transform7417Added a new field, Format as canonical XML, to the XSLT Snap that enables canonical XML formatting.
All Snap Packs6/11/2019ALL7402Pushed automatic rebuild of the latest version of each Snap Pack to SnapLogic UAT and Elastic servers.
SQL Server6/10/2019db/sqlserver7394Fixed an issue wherein bit data types in the SQL Server - Select table convert to true or false instead of 0 or 1.
MySQL6/10/2019db/mysql7395Fixed an issue wherein bit data types in the MySQL - Select table convert to true or false instead of 0 or 1.
Snowflake6/10/2019db/snowflake7396Fixed an issue wherein bit data types in the Snowflake - Select table convert to true or false instead of 0 or 1.
Binary6/7/2019binary7381Fixed an issue with SMB accounts wherein login to the server fails if password contains a plus (+) sign.
Salesforce6/7/2019salesforce7352

Fixed an issue with the Read and SOQL Snaps wherein Pipeline validation fails because of a dynamic account opening multiple file descriptors.

SumoLogic6/5/2019sumologic7369Fixed an issue with the Execute Search Job Snap wherein it fails to return the results correctly.
Binary6/4/2019binary7366

Added support for multiple slashes as a prefix for SMB file URLs.

MySQL6/3/2019db/mysql7357Fixed an issue with the MySQL Execute snap wherein the Retry property for connection fails after the database connection is severed.
Snowflake 5/31/2019db/snowflake7334

Added AWS Server-Side Encryption support for AWS S3 and AWS KMS (Key Management Service) for Snowflake Bulk Load, Snowflake Bulk Upsert, and Snowflake Unload Snaps.

MongoDB5/24/2019db/mongo7331Fixed an issue with the MongoDB - Update Snap wherein the Snap converts all non-updated integer and float data types to string data type.
Google Spreadsheet5/15/2019google/spreadsheet7283

Fixed an issue with the Worksheet Writer Snap wherein the No of valid records written field in the output document would count the header row.

Binary5/15/2019binary7280

Added a new field, File delete action, to the File Delete Snap that handles missing target files.

Platform

Update DateBuildUpdates
7/2/2019

master-5492
Control Plane Only

Enhanced SSO Login functionality to support additional authentication methods RequestedAuthnContext and RequestedAuthnContext Comparison at the Org-level. As an Org admin, you can configure these additional options for user logins across your Org.
6/28/2019master-5508 - Patch 4 
(Recommended)
  • Fixed an issue that can cause Pipeline Execute child pipelines to fail while loading accounts.
6/13/2019master-5472 - Patch 3 
  • Fixed an issue that causes Groundplex triggered Pipelines comprising Pipeline Execute Snap with child Pipelines and performing an SLFS operation to fail with a 401 error.
  • Fixed an issue that causes expression verification to generate warnings for the Pipeline suggest feature.
6/4/2019master-5396 - Patch 2

Fixed a performance issue in Tasks triggered on a Groundplex, where the Pipeline uses the Pipeline Execute Snap to invoke a child Pipeline that references expression libraries.

5/22/2019master-5365 - Patch 1
  • Added a retry handler to manage network failures during Pipeline information retrieval.
  • Enhanced performance optimization for Groundplex Triggered Pipelines that use the Pipeline Execute Snap.
  • Fixed an issue which causes some Pipelines, typically with Union Snaps, to hang during execution.
  • Fixed an issue which causes some Pipeline creation times to show as Invalid date.
5/20/2019N/A
  • Fixed an issue causing Groundplex Triggered Task invocations to perform permission checks as the invoker instead of the Task owner.
  • Fixed an issue causing Groundplex Triggered Tasks to fail if the CC user is present as a member of the organization.
  • Fixed an issue causing runtime pushes to fail if a large number of Groundplex triggers are done concurrently.

UI

Update DateBuildUpdates
6/13/2019N/A
  • Fixed an issue with the Dependent Keys that causes the DataViz data preview to crash intermittently. 
  • Fixed an issue with the Visualization Key dropdown that does not let you scroll all the column values if they overflow the given dropdown size.
  • Fixed issues with the Expression Builder for a Snap wherein you cannot undo an action; the cursor defaults to the beginning position while editing; and the scroll bar is missing.
  • Fixed an issue with the Snap properties view that does not close when clicking the esc key on the keyboard.
5/20/2019N/A
  • Fixed an issue where a script error appears when saving a Snap with a file input field (such as File Writer) in a Pipeline while at the same time another Snap with a file input field (like File Reader) is open in a different Pipeline.
  • Fixed an issue where the JSON and Table View displays the new line character (\n) incorrectly in the Snap output preview.
  • Fixed an issue with Snap recommendations when checking the compatibility of view type of the Mapper and Pipeline Execute Snaps because both Snaps support binary and document input/output.


...