Versions Compared

Old Version 6

changes.mady.by.user Anand Vedam

Saved on

compared with

New Version 7

changes.mady.by.user Anand Vedam

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Field Name

Type

Description

Label*

String

Specify a unique label for the Snap.

Default Value: ELT Case Expression
Example: Order_Selection_Cases

Get preview data

Checkbox

Select this checkbox to include a preview of the query's output. The Snap performs limited execution and generates a data preview during Pipeline validation.

Info

In the case of ELT Pipelines, only the SQL query flows through the Snaps but not the actual source data. Hence, the preview data for a Snap is the result of executing the SQL query that the Snap has generated in the Pipeline.

The number of records displayed in the preview (upon validation) is the smaller of the following:

  • Number of records available upon execution of the SQL query generated by the Snap.

  • The value set in the Preview Data Count setting (default is 50 records).

Rendering Complex Data Types in Databricks Lakehouse Platform

Based on the data types of the fields in the input schema, the Snap renders the complex data types like map and struct as object data type and array as an array data type. It renders all other incoming data types as-is except for the values in binary fields are displayed as a base64 encoded string and as string data type.

Default Value: Not selected
Example: Selected

Pass through

Checkbox

Select this checkbox to specify that the Snap must include the incoming document (SQL query) in its output document.

Note

If this checkbox is selected and there are no Case expressions defined in the Case Arguments fieldset below, Subquery Pushdown Optimization logically ignores this Snap—sends the input SQL query coming from the immediately upstream Snap as its output SQL query.

Alias

String

Specify the alias name to use for the case arguments specified.

Default Value: None.
Example: case_alias1

Case Arguments

Specify your case arguments using this fieldset. A case argument is essentially an action to perform on the source data when a specific condition is met. Ensure that you specify mutually exclusive case arguments.

Specify each value in a separate row. Click (blue star) to add a new row.

This field set consists of the following fields:

  • When

  • Then

When

String/Expression

Specify the case (condition to be met).

Default Value: None.
Example: TOTAL_ORD_CNT < 100

Then

String/Expression

Specify the action to be performed when the corresponding case (condition) is met.
Default Value: None.
Example: TOTAL_DISC = TOTAL_ORD_AMT * DISC_100

Else

String/Expression

Specify the action to be taken performed if none of the case arguments defined are is satisfied.

Default Value: None.
Example: TOTAL_DISC = TOTAL_ORD_AMT * DISC_NONE

...