Fixed an issue with the CSV Parser Snap that introduced unexpected characters into the records and output data because of incorrect handling of the delimiter.

Fixed an issue with the JSON Generator and XML Generator Snaps that caused unexpected output displaying '__at__' and '__h__' instead of '@' and '-' respectively because the Snap could not update them to their original values after the Velocity library upgrade.

Fixed an issue with the Sort where the Snap could not sort files larger than 52 MB. This fix applies to Join Snap also.

• Fixed an issue with the Sort Snap that displayed an error when estimating the size of the input document provided by the upstream S3 Browser Snap.
• Fixed an issue with the Parquet Formatter Snap that was unable to route errors to the error view.

• Added expression support to the Skip lines field in the CSV Parser Snap to enable passing pipeline parameters and upstream values. 

• Fixed an issue with the XML Parser Snap that caused an error when using the Splitter option in the Snap settings. 

• Added Parquet Parser and Parquet Formatter Snaps to the Transform Snap Pack:
  • Parquet Parser: Reads the binary Parquet data and writes document data to the output.
  • Parquet Formatter: Reads the document data and writes it to the output in binary Parquet format.

• Enhanced the JSON Splitter Snap to capture metadata and lineage information from the input document.

Fixed an issue with the JSON Formatter Snap that generated incorrect schema.

Fixed an issue with the Aggregate Snap where the Snap was unable to produce the desired number of output documents when the input was unsorted and the GROUP-BY fields field set was used.

Fixed a deserialization issue for a unique function in the Aggregate Snap.

• Fixed an issue with the Transform Snap Pack that caused an error when the input file was a binary JSON file that contained a string value of more than 20,000,000 characters.

• Fixed a memory issue with the Aggregate Snap that occurred when using GROUP-BY fields.

Fixed an issue with the JSON Splitter Snap that caused the pipeline to terminate with excessive memory usage on the Snaplex node after the 4.33 GA upgrade. The Snap now consumes less memory.

• Fixed an issue with the Excel Multi Sheet Formatter Snap that caused it to produce binary output data when there was no input document and Ignore empty stream was selected.
• Introduced the following new Snaps:

  • GeoJSON Parser: Parses geospatial data from binary data input and outputs the contents as a GeoJSON document downstream.

  • WKT Parser: Parses geospatial data from binary data input and outputs the contents as a WKT (Well Known Text) document downstream.

The Decrypt Field and Encrypt Field Snaps now support CTR (Counter mode) for the AES (Advanced Encryption Standard) block cipher algorithm.

The Decrypt Field Snap now supports the decryption of various encrypted fields on providing a valid decryption key.

The following Transform Snaps include new fields to improve memory management: Aggregate, Group By Fields, Group By N, Join, Sort, Unique.

Fixed an issue with the AutoPrep Snap where dates could potentially be rendered in a currency format because currency format options were displayed for the DOB column.

Fixed an issue with the Encrypt Field Snap, where the Snap failed to support an RSA public key to encrypt a message or field. Now the Snap supports the RSA public key to encrypt the message.

The Join Snap is enhanced with the following:

• The Pipeline Execution Statistics of the Join Snap now has a status message that displays the parameters - Free disk space, Available memory, and Average document size.

• The internal sort buffer size is reduced to a minimum of 10MB when the available memory in the node becomes lower than 500MB to avoid the out-of-memory crash.

• The internal sort buffer size is restored to its original size when the available memory becomes larger than 2GB.

• We have improved the readability of the error message for the out of disk space on node error. The updated error message now provides clearer information and guidance for users, as shown below:
  Reason: Insufficient free disk space available to stage sort data into temporary files.
  Resolution:  Increase the amount of free disk space and try again.

432patches20250

• Fixed an issue with the JSON Splitter Snap that was causing errors when using multiple repeated dots in the JSON Path.

• The Sort Snap includes the following improvements:

  • The Maximum memory % field is revised to Maximum memory.

  • The Maximum memory unit (new dropdown list) enables you to choose a unit, percentage (%), or MB for better memory control.

Fixed an issue that occurred with the JSON Splitter Snap when used in an Ultra pipeline. The request was acknowledged before it was processed by the downstream Snaps, which caused a 400 Bad Request response.

• Fixed an issue with the CSV Formatter Snap where the Unicode character delimiters using [0-9a-f] did not work.

• Fixed an issue with the JSON Splitter Snap that was generating null values for empty input data.

The Encrypt Field Snap supports decryption of encrypted output in Snowflake Snaps.

The Transform Join Snap now doesn’t fail with the Null Pointer Exception when you configure the Sorted streams field with Ascending.

• The Excel Formatter and Excel Multi Sheet Formatter Snaps now include a Convert formula strings to formulas checkbox.

• The Mapper Snap now has a Sorted checkbox in the Input Schema and Target Schema panels, which allows you to sort the input and target schemas. When unchecked, the Snap unsorts the input and the target schema.

The CSV Formatter and CSV Parser Snaps now support shorter values of Unicode characters.

• The AutoPrep feature now includes the following new transformation options that enable you to:
  • Change the field data type from Data type menu.
  • Format dates and date Strings.
  • Rename a field.
  • Mask sensitive data using an MD5, SHA-1, SHA-256, or SHA-512 algorithm.
• The data in the Preview data pane format is easier to read and the buttons have been changed to improve usability.

The CSV Parser Snap now parses data with empty values in the columns when using a multi-character delimiter.

The Transcoder Snap used in a low-latency feed Ultra Pipeline now acknowledges the requests correctly.

The Avro Parser Snap now displays the decimal number correctly in the output view if the column’s logical type is defined as a decimal.

The CSV Formatter Snap does not hang when running in specific situations involving multibyte characters in a long field. If you notice the CSV Formatter Snap is hung, we recommend that you update to the 430patches17589 version and restart your Snaplex.

• New Snap Application: The Auto Prep Snap provides a data preparation application where you can flatten structured data, include and exclude data fields, and change data types before forwarding the data for further processing.

• The Hide whitespace option in the CSV Generator and JSON Generator Snaps allows you to hide the rendering of whitespace as symbols (dot or underscore) in the output that you may have in the CSV or JSON input documents.

• The Render whitespace checkbox in the Mapper Snap enables or disables the rendering of whitespace in the input document. When a value in the Expression field has blank spaces (leading, trailing, or spaces in the middle of a string), the spaces are rendered as symbols (dot “.” or underscore “_”) in the output on selecting this checkbox.

• The Excel Parser Snap includes the Custom Locale dropdown list that allows selecting a user-defined locale for formatting numbers..

• The Selected fields in the Pivot Snap allow you to define fields to be unpivoted so that the remaining fields are automatically pivoted.

• The XML Generator Snap includes examples on how to escape single (') and double quotes (“) when used with elements or attributes.

• Fixed an issue with the Aggregate Snap where the Snap failed to validate (after first successful validation) while using a field that may contain a date for MIN and MAX functions. The Snap now supports DATE-type fields.

• Enhanced the Pivot Snap with the Treat selected fields as static checkbox that enables the Snap to treat the selected fields as static to preserve the structure of the selected fields while all other fields are pivoted.

• Enhanced the CSV Formatter and CSV Parser Snaps to support multiple characters or strings as delimiters.

• Fixed an issue with the Join Snap where the Snap displayed an incorrect error if the Left path or Right path fields were expression-enabled or if you have specified properties other than the field name and irrespective of whether the Sorted streams field is Unsorted or not. For example, "$first + '2' . Now, the Snap runs properly if the Left path or Right path was expression enabled and you have specified properties other than the field name and the Sorted streams field is Sorted or Unsorted. The Snap now displays a proper error that is more informative, in case there is a problem while executing this Snap.

• Fixed an issue with CSV Parser Snap where the Snap failed when more than six characters are used as delimiters. Now, the Snap executes properly when you use more than six characters as delimiters.

• Removed the default value for the Root element field in the XML Formatter Snap.
• Fixed an issue with the Transcoder Snap where the Input character-set field was not displaying the suggestions properly.