Input 

Document

• Min: 2

• Max: 2

• Sort

• CSV Generator

• Union

• Exit

• Router

This Snap has exactly two document input views, New and Original.

Ensure the first input is always New and the second input as Original in order for the Snap to display the output (insertions/deletions/modifications) in reference to the original document.

Output

Document

• Min: 4

• Max: 4

• Mapper

• Filter

• Union

This Snap has four document output views:

• Deletions - Contains documents that exist in the Original view but not the New view.

• Insertions - Contains documents that exist in the New view but not the Original view.

• Modified - Contains documents that exist in both views, but are different in some property.

• Unmodified - Contains documents that are the same in both input views.

Error

Error handling is a generic way to handle errors without losing data or failing the Snap execution. You can handle the errors that the Snap might encounter while running the Pipeline by choosing one of the following options from the When errors occur list under the Views tab:

• Stop Pipeline Execution: Stops the current pipeline execution if the Snap encounters an error.

• Discard Error Data and Continue: Ignores the error, discards that record, and continues with the remaining records.

• Route Error Data to Error View: Routes the error data to an error view without stopping the Snap execution.

Learn more about Error handling in Pipelines.

Label*

Default Value: Diff
Example: Diff_new

String

Specify the name for the Snap. You can modify this to be more specific, especially if you have more than one of the same Snap in your Pipeline.

Sort paths*

Default value: None
Example: $person.firstname

String

Specify the list of paths to sort on. For example, to sort a list of person objects by the field 'firstname', then $person.firstname should be used.

Sort order*

Default value: Ascending
Example: Descending

Dropdown list

Ordering of the sort of the data coming in. Allowed values are ascending or descending.

Output view mapping*

String

Allows you to map output view name to output view type if you removed and then re-added output views.

Snap Execution

Default Value: Validate & Execute
Example: Disabled

Dropdown list

Select one of the following three modes in which the Snap executes:

• Validate & Execute: Performs limited execution of the Snap, and generates a data preview during Pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during Pipeline runtime.

• Execute only: Performs full execution of the Snap during Pipeline execution without generating preview data.

• Disabled: Disables the Snap and all Snaps that are downstream from it.

Consider that the original file contains only a few records (as demonstrated being created in a CSV Generator Snap, but can be read from a File Reader with a CSV Parser).

Open

By comparison, the new file has over 1000 records (again, demonstrated being created in a CSV Generator Snap).

Because the comparison can only be done by sorted stream, each file will need to be sorted by the same column, such as $Last, with the same sort order, so add a Sort Snap after each file input (CSV Generators in this example).

Next, configure the Diff Snap with the Sort path and Sort order. 

This results in deleted lines routing to the Deletions view, new lines to the Insertions view, modified lines to the Modified view, and unchanged lines to the Unmodified view