Versions Compared

Old Version 7

changes.mady.by.user Anand Vedam

Saved on

compared with

New Version 8

changes.mady.by.user Anand Vedam

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Field Name

Type

Description

Label*

String

Specify a unique label for the Snap.

Default Value: ELT Coalesce
Example: Coalesce for AVG values

Get preview data

Checkbox

Select this checkbox to include a preview of the query's output. The Snap performs limited execution and generates a data preview during Pipeline validation.

Info

In case of ELT Pipelines, only the SQL query flows through the Snaps but not the actual source data. Hence, the preview data for a Snap is the result of executing the SQL query that the Snap has generated in the Pipeline.

The number of records displayed in the preview (upon validation) is the smaller of the following:

  • Number of records available upon execution of the SQL query generated by the Snap.

  • The value set in the Preview Data Count setting (default is 50 records).

Note

Rendering Complex Data Types in Databricks Lakehouse Platform

Based on the data types of the fields in the input schema, the Snap renders the complex data types like map and struct as object data type and array as an array data type. It renders all other incoming data types as-is except for the values in binary fields are displayed as a base64 encoded string and as string data type.

Default Value: Not selected
Example: Selected

Pass through

Checkbox

Select this checkbox to include the original input data in the output document along with the results of the COALESCE operation.

Default Value: Not selected
Example: Selected

Coalesce Alias

String

Enter the column alias name for storing the results of the COALESCE operation. Leave this field blank to allow the Snap to automatically define an alias name for the column.

Default Value: None
Example: NewCoaleas

Coalesce Arguments

Specify the list of arguments based on the input data schema for performing the COALESCE operation. Each function must be specified as a new row. Click (blue star) to add a row.

This field set consists of the following fields:

  • Coalesce Argument

Coalesce Argument

String/Expression

Enter an argument for performing the COALESCE operation. Define only one argument in this field.

Default Value: None
Example: ORDER_CNT, ORDERS_AVG_AMT

...