SOAP

Aug 8, 2022

429patches17186

Fixed an issue with the SOAP Execute Snap where the Snap displayed an error when a valid WSDL getOrderStatus SOAP operation was uploaded.

Redshift

Jul 28, 2022

429patches16908

• Enhanced the Redshift accounts with the following:

  • Expression enabler to pass values from Pipeline parameters.

  • Support for Security Token for S3 bucket external staging.

• Fixed an issue with Redshift - Execute Snap where the Snap failed when the query contained comments with single or double quotes in it. Now the Pipeline executes without any error if the query contains a comment.

RabbitMQ

Jul 27, 2022

429patches17049

Enhanced the RabbitMQ Consumer Snap with:

• Acknowledgment Type dropdown list that allows you to set the acknowledgment type, which is available only when you select Auto_Acknowledgement in the Message Acknowledge Mode field.

• A default 30-minute acknowledgment timeout—the Snap waits only for 30 minutes to get an acknowledgment. When there is no acknowledgment even after 30 minutes, Snap considers the status as unacknowledged and moves to the subsequent message.

NetSuite

Jul 26, 2022

429patches16915

Fixed an issue with NetSuite Search Snap where the Snap displayed the Could not translate an element declaration element exception intermittently when multiple search Snaps are executed simultaneously.

MS Dynamics 365 for Sales

Jul 22, 2022

429patches17123

• Dynamics 365 OAuth2 Account For Online now supports on-premise usage that allows you to access the latest version of the APIs supported in the Microsoft Dynamics 365 suite.

• Fixed an issue with the Dynamics 365 For Sales Read Snap where the Snap displayed a Null Pointer error instead of the actual 429 HTTP status code - Too Many Requests error from the endpoint, and the Pipeline failed. Now Snap does not display a Null Pointer error if it encounters a 429 error and the Pipeline transitions to the completed state.

• Fixed an issue with Dynamics 365 For Sales Upsert Snap where the Snap displayed a different error message in the error view when the batch size is greater than 1.

• Fixed an issue with Dynamics 365 For Sales Update and Dynamics 365 For Sales Upsert Snaps where the Snaps wrote to both output view and error view when the update fails and batch size equals 1. Now the Snap writes only to the error view when the update fails.

• Fixed an issue with Dynamics 365 For Sales Update and Dynamics 365 For Sales Upsert Snaps where the Snaps did not write to the output view when the response is null. Now the Snaps correctly write to the output view when the response is null.

• Enhanced the Dynamics 365 For Sales Update and Dynamics 365 For Sales Upsert Snaps with Alternate Keys fieldset that enables you to refer to entities by unique or nonunique combinations of columns.

Transform

Jul 22, 2022

429patches16990

• Fixed an issue with the Aggregate Snap where the Snap failed to validate (after first successful validation) while using a field that may contain a date for MIN and MAX functions. The Snap now supports DATE-type fields.

• Enhanced the Pivot Snap with the Treat selected fields as static checkbox that enables the Snap to treat the selected fields as static to preserve the structure of the selected fields while all other fields are pivoted.

Transform

Jul 21, 2022

429patches16923

• Enhanced the CSV Formatter and CSV Parser Snaps to support multiple characters or strings as delimiters.

• Fixed an issue with the Join Snap where the Snap displayed an incorrect error if the Left path or Right path fields were expression-enabled or if you have specified properties other than the field name and irrespective of whether the Sorted streams field is Unsorted or not. For example, "$first + '2' . Now, the Snap runs properly if the Left path or Right path was expression enabled and you have specified properties other than the field name and the Sorted streams field is Sorted or Unsorted. The Snap now displays an informative error on encountering an issue while executing this Snap.

• Fixed an issue with CSV Parser Snap where the Snap failed when more than six characters were used as delimiters. Now, the Snap executes properly when you use more than six characters as delimiters.

Teradata

Jul 21, 2022

429patches16235

Fixed an issue with Teradata Execute Snap where the Snap did not display a valid error message when the delete condition was invalid.

SQL Server

Jul 21, 2022

429patches16235

Fixed an issue with SQL Server Execute Snap where the Snap did not display a valid error message when the delete condition was invalid.

Snowflake

Jul 21, 2022

429patches16478

Fixed an issue with Snowflake - Bulk Load Snap where Snap failed with 301 status code - SnapDataException.

PostgreSQL

Jul 21, 2022

429patches17036

Enhanced the PostgreSQL Account and PostgreSQL Dynamic Account with SSH Tunneling configurations to encrypt the network connection between the client and the PostgreSQL Database server, thereby ensuring the secure network connection.

OpenAPI

Jul 21, 2022

429patches16939

• Enhanced the OpenAPI Snap with the following:

  • Pass through checkbox that allows you to pass input data to the output under Original key.

  • Trust all certificates checkbox that allows you to use self-signed certificates.

  • Enable URL Encoding checkbox that allows automatic URL encoding of the request path.

  • Support for external files referenced in the OpenAPI specification field.

Kafka

Jul 21, 2022

429patches17109

• Enhanced the Kafka Producer Snap with LZ4 and ZSTD Compression Types for compressing the messages that optimize Snap's performance.

• Fixed an issue with the Kafka Producer Snap where th Snap wrote an output document even when there was an error.

• Fixed an issue with Kafka Account where the expression buttons were enabled, by default, for the Bootstrap Server and Advanced Property Value fields.

• Upgraded Kafka client libraries to Apache-Kafka Version 3.1.1 and Confluent-Kafka Version 7.1.1.

• Enhanced the Kafka account, which is configured to connect to the Kafka Schema Registry, to use TLS v1.2 protocol instead of TLS that has security vulnerabilities.

Hadoop

Jul 21, 2022

429patches16630

• Extended the AWS S3 Dynamic Account support to ORC Reader and ORC Writer Snaps to support AWS Security Token Service (STS) using temporary credentials.

• Fixed an issue in the following Snaps that use AWS S3 dynamic account, where the Snaps displayed the security credentials like Access key, Secret key, and Security Token in the logs. Now, the security credentials in the logs are blurred for the Snaps that use AWS S3 dynamic account.

  • ORC Reader

  • ORC Writer

  • Parquet Reader

  • Parquet Writer

DynamoDB

Jul 21, 2022

429patches16169

Fixed an issue with the DynamoDB Snaps where the Snaps did not route the errors to the error view when the Snap encountered an exception and the Pipeline failed. Now the Snap route the errors to the error view and does not fail when it encounters an exception. If the error view is disabled, Snap stops the execution.

Azure SQL

Jul 21, 2022

429patches16545

Fixed an issue with the Azure SQL-Stored Procedure Snap where the Snap failed with an Invalid value type error when the stored procedure contained a NCHAR data type.

Google Directory

Jul 21, 2022

429patches16728

• Enhanced the Google Directory Insert Snap where the Snap did not display the original payload in the error view. Now, the original payload is passed to the error view.

• Enhanced the Google Directory Update Snap where the original payload is displayed in the error view, but not under the original tag. Now the original payload is displayed under the original tag.

Binary

Jul 21, 2022

429patches16569

• Enhanced the File Operation Snap to support moving data from local node to Azure blob through the AZ Copy utility.

• Enhanced Azure Storage Account with the Request Size (MB) field to set the buffer limit before writing to Azure storage to enhance the performance.

• Enhanced the following Binary Snaps to partially support '?' character in the file names and file paths:

  • Directory Browser

  • File Delete

  • File Operation

  • File Poller

  • File Reader

  • File Writer

  • Multi File Reader

  • ZipFile Read

  • ZipFile Write

ML Core

Jul 20, 2022

429patches16809

Removed the log4j dependency from the ML Core Snaps due to security vulnerabilities.

REST

Jul 19, 2022

429patches17084

• Enhanced the REST Snaps (Delete, Get, Patch, Post, and Put) with Cookie Policy dropdown list to set the cookie policy specifications. This field is case-insensitive.

• Added Security Token field in the REST AWS Sig v4 Account to support AWS Security Token Service (STS) for using temporary credentials.

• Enhanced the REST AWS Sig v4 Account to support expression values for Access-key ID and Secret Key fields.

Google Sheets

Jul 18, 2022

429patches16975

• Fixed an issue with the Worksheet Writer Snap where the Snap failed to write data correctly after each batch write. 
  When the Write Mode is Create New Worksheet and Overwrite worksheet if it exists checkbox is selected, the cell data is shifted by five columns to the right after each batch in the resulting worksheet. Now, the data is written correctly in the worksheet.

• Enhanced the following in the Worksheet Writer Snap:

  • Support of expressions for the Starting Cell Reference field.

  • Added a warning about potential overwriting of existing data for the Starting Cell Reference field when writing data in the same range of cells.

• Introduced the following Snaps:

  • Google Sheet Subscribe Snap that allows you to subscribe to the specified spreadsheet for notifications of the changes in the Google Sheet.

  • Google Sheet Unsubscribe Snap that allows you to unsubscribe a spreadsheet.

Azure Active Directory

Jul 12, 2022

429patches16884

Fixed the following issues in the Azure Active Directory OAuth2 account:

• Removed the Header authenticated checkbox.

• Modified the default values for OAuth2 Endpoint and Token values where the tenant-id was hardcoded. Now the tenant id is displayed as <tenant-id*> and not a static value.

Fixed the following issues in the Azure Active Directory Search Entries Snap:

• The Snap retrieved only 1000 records and did not retrieve all the records from the directory. Now, Snap retrieves all the records from the directory.

• The Snap failed with the 400 status code error during validation and aborted during execution when values were added in the Properties field. Now, Snap does not fail whether you add values to the Properties field or not.

Transform

Jul 7, 2022

429patches16521

• Removed the default value for the Root element field in the XML Formatter Snap.

• Fixed an issue with the Transcoder Snap where the Input character-set field was not displaying the suggestions properly.

SAP

Jul 7, 2022

429patches16637

• Fixed an issue with the SAP IDoc Write Snap where the Snap wrote the same TID, Document_number, and so on for the different output documents though the I_DOCNUM array contained all the document numbers that are returned from SAP table. Now, the Snap writes different TID, Document_number for different output documents along with the I_DOCNUM array that contains all the document numbers.

• Fixed an issue with SAP Execute and SAP IDoc Write Snaps where the output preview did not include the original document.

Transform

Jul 5, 2022

429patches16026

Enhanced the Excel Parser Snap with the Custom Locale dropdown list that allows you to select a user-defined locale to format numbers as per the selected locale.

Salesforce

Jun 29, 2022

429patches16708

• Updates in Salesforce Subscriber Snap:

  • Upgraded the Cometd version from 5.0.9 to the latest 7.0.6 version.

  • Fixed an issue where the Snap reported an error and stopped only at the next resubscribe attempt when it encountered the daily limit exceeded error. Now, the Snap displays the error and stops immediately when it encounters the daily limit exceeded error.

  • Simplified the logging that provides useful diagnostic information without logging any sensitive data.

  • Enhanced the Snap design to make the callbacks or listeners asynchronously by the Cometd API when there is a specific event, and the Snap responds accordingly.

  • Enhanced the tracking of replay ID of the most recent message processed so that Snap can send that replay ID if there is a need to resubscribe. If the server responds that the replay ID is invalid, Snap automatically sets the Replay ID value to -2 to get all available messages.

• Made the Null Setting with Bulk API checkbox in the Salesforce Update, Salesforce Create, and Salesforce Upsert Snaps visible to format a null value.

Oracle

Jun 29, 2022

429patches16603

• Fixed an issue with Oracle Bulk Load Snap where the Snap encountered an error when trying to load data into Timestampwithtimezone datatype field.

• Fixed an issue with Oracle Execute Snap where the Snap did not display a valid error message when the delete condition was invalid.

• Fixed an issue with Oracle - Merge Snap where the Snap displayed an error when the RetryInterval and Number of Retries fields were expression enabled and the values were passed using the Pipeline parameters.

• Fixed an issue with the Oracle Stored Procedure Snap where the Snap errored out due to an upgrade made to HikariCP that caused a conditional failure and prevented the downstream Snaps to supply the parameters to the stored procedure. 

• Enhanced the Oracle - Merge and Oracle - Update Snaps with the Session parameters fieldset that provides National Language Support (NLS).

Azure SQL

Jun 28, 2022

429patches16460

Fixed an issue with Azure SQL Bulk Load Snap where the Snaplex exited due to insufficient memory when a large number of rows are loaded into the target table and the input data contained a null value for a non-nullable column.

Snowflake

Jun 27, 2022

429patches16458

• Fixed the following issues with the Snaps that use Snowflake Accounts Key Pair Authentication.

  • The Snaps were not able to read the private keys provided as Pipeline parameters, because the key was malformed by replacing the line breaks with whitespace characters. Now, the private keys are properly formed and read when provided as Pipeline parameters.

  • The Snap displayed a Null Point Exception error when you pass an invalid key into the Private Key field like test. Now, the Snap displays a valid error message.

• Fixed an issue with the Snowflake Snaps due to an upgrade made to HikariCP that caused a conditional failure and prevented the downstream Snaps to supply the parameters to the stored procedure. 

• Fixed an issue with Snowflake Execute and Snowflake Select Snaps where the Snap displayed an exception error when the FLOAT or DOUBLE datatype column has the value as NaN (Not a Number). Now the output value is written as-is (NaN) for FLOAT or DOUBLE datatype column and does not display an exception.

• Enhanced the following Snowflake Accounts with support for Key Pair Authentication.

  • Snowflake Azure Database Account

  • Snowflake Google Storage Database Account

  • Snowflake S3 Database Account

  • Snowflake S3 Dynamic Account

• Removed support for unencrypted Private Keys to enforce security in Snowflake accounts.

JDBC

Jun 24, 2022

429patches16588

• Fixed an issue with JDBC Select and JDBC Insert Snaps where the Snaps did not load suggestions for the Table property. Now the Snaps load the suggestions correctly.

• Enhanced the Generic Database account to support dynamic values for Account properties, Advanced properties, and URL properties so that you can pass these values through Pipeline parameters.

MongoDB

Jun 23, 2022

429patches15807

Updated the expected output for the MongoDB - Update Snap that is changed due to the upgrade of Spring Core framework version.

ELT

Jun 17, 2022

429patches16665

• Enhanced the ELT Snap Pack to support the latest JDBC drivers across CDWs—Azure Synapse, BigQuery, DLP, Redshift, and Snowflake. See Configuring ELT Database Accounts or the respective Account page for the exact versions.

• Enhanced the ELT Pivot Snap to make the Value List field dynamic.

• Enhanced the ELT Snowflake Account with support for Key Pair Authentication.

• Enhanced the ELT DLP Account to configure S3 Bucket, Azure Storage, and DeltaLake Storage Gen2 mounts.

• Enhanced the end Snap SQL query in the ELT Insert Select Snap’s preview output to display the CREATE TABLE... or the DELETE/DROP TABLE statements to be run before the query that inserts/loads data into a new table in the Snowflake target CDW.

• Fixed the issue with ELT Load Snap where the Snap caused an SQL exception—[Simba][SparkJDBCDriver](500051) ERROR processing query/statement when reading from a CSV file in S3 mount point on DBFS in the case of a DLP target instance.

• The ELT Insert Select, ELT Merge Into, ELT Load, and the ELT SCD2 Snaps now run successfully even when the specified target table does not exist. The Snaps now create a new target table if it does not exist during Pipeline validation.

• The ELT SCD2 Snap:

  • Upon Pipeline validation, displays the final SQL query to be executed on the target CDW in its output preview.

  • Can replace an existing target table with a new table and load the SCD2 entries from the source table/files into it. Use the new Overwrite existing table option in the Target Table action field to perform this action.

• Updated the field names in ELT Aggregate, ELT Cast Function, ELT String Function, and ELT Transform Snaps to maintain consistency.

Marketo

Jun 9, 2022

429patches16430

• Fixed an issue with Marketo OAuth2 Account where the Snaps failed with ACCESS TOKEN EXPIRED error. Now the Snaps that use Marketo OAuth2 Account work as expected and does not display an expired token error.

• Fixed an issue with Marketo Bulk Lead Upsert Snap where the Snap processed only successfully submitted batch jobs. Now, the Snap processes the failed batch jobs and logs the response message for each status.

• Fixed an issue with Marketo Bulk Lead Upsert Snap where the Snap hung when parsing large data.

• Fixed an issue with Marketo Bulk Lead Upsert and Bulk Lead Extract Snaps where the Snaps did not display valid error messages for Timeout and Number of Retries property when the input is large, empty, or Null.

• Fixed an issue with Marketo Bulk Lead Upsert and Bulk Lead Extract Snaps where the Snaps failed without any reason when the Timeout value was less than 10 seconds.

Azure Active Directory

Jun 9, 2022

429patches16391

Enhanced the Azure Active Directory Search Entries Snap with Properties field to display the attributes you want to view in the output.

Redshift

Jun 8, 2022

429patches15806

Fixed an issue with Redshift Account and Redshift SSL Account where the Redshift Snaps failed when the S3 Secret key or S3 Access-key ID contained special characters, such as +.

SAP

Jun 7, 2022

429patches16113

Fixed an issue with SAP Execute Snap where the Snap incorrectly handled connection exceptions for 104-JCO_ERROR_SYSTEM_FAILURE. Previously, the Snap captured only the output document without the error. Now, the Snap correctly captures both the output and error.

Slack

Jun 1, 2022

429patches16199

• Fixed an issue with the Send Message Snap where the Snap displayed a Null Pointer Exception error when you select User Emails for the Target Type field and the user email id contained null, for example, @slackbot:null. Now, the Snap displays a valid error message.

• Fixed an issue with the User ID field for the following Slack Snaps where the Snap failed with the User not found error when using @user.name in the User ID field.

  • Channel Operations

  • Delete Message

  • Send Message

  • Upload File

  • User Operations

ELT

May 28, 2022

4.29patches16287

Fixed an issue with the ELT SCD2 Snap where the Snap was rounding off decimal values to the nearest integer—the value 57.601000000000 in the source table was written to the target table as 58.000000000.

Binary

May 24, 2022

429patches15842

• Improved the tooltip for the File action field in the ZipFile Write Snap.

• Enhanced the SSH Auth Account with Expression enabler () for the following fields that allow the use of Pipeline parameters to populate the properties.

  • Username

  • Private key

  • Key passphrase

DynamoDB

May 20, 2022

429patches15954

• Enhanced the DynamoDB Account with AWS Security Token field to pass the security token when making calls using temporary credentials.

REST

May 20, 2022

429patches16076

• Enhanced the REST Snaps with support for auto-retry where the Snap retries automatically when the Snap encounters 429 HTTP status code - Too Many Requests error.

• Improved the performance of REST Snaps when the Snaps encountered errors due to Unauthorized (401) or Forbidden (403) statuses though the user credentials are available in the organization and the account type is OAuth2.