Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Parameter NameData TypeDescriptionDefault ValueExample 
LabelString
Excerpt Include
File Reader
File Reader
nopaneltrue
N/ADeduplicate Office Names

Threshold

Decimal

Required. The minimum confidence required for documents to be considered matched as duplicates using the matching criteria.

Minimum Value: 0

Maximum Value: 1

0.80.95
ConfidenceCheck box

Select this check box to include each match's confidence levels in the output.

DeselectedN/A
Group IDCheck boxSelect this check box to include the group ID for each record in the output.DeselectedN/A
Matching CriteriaFieldsetEnables you to specify the settings that you want to use to match input documents with the matching criteria.N/AN/A

Field

JSONPath

The field in the input dataset that you want to use for matching and identifying duplicates.

N/A$name

Cleaner

String
Multiexcerpt include macro
namecleaner
pageMatch
NoneText

Comparator

String
Multiexcerpt include macro
namecomparator
pageMatch
LevenshteinNumeric

Low

Decimal

A decimal value representing the level of probability of the input documents to be matched if the specified fields are completely unlike.

Note

If this value is left empty, a value of 0.3 is applied automatically.


N/A0.1

High


Decimal

A decimal value representing the level of probability of the input documents to be matched if the specified fields are a complete match.

Note

If this value is left empty, a value of 0.95 is applied automatically.


NA0.8
Snap ExecutionString


Multiexcerpt macro
namesnap_execution

Specifies the execution type:

  • Validate & Execute: Performs limited execution of the Snap (up to 50 records) during Pipeline validation; performs full execution of the Snap (unlimited records) during Pipeline execution.
  • Execute only: Performs full execution of the Snap during Pipeline execution; does not execute the Snap during Pipeline validation.
  • Disabled: Disables the Snap and, by extension, its downstream Snaps.


Validate & ExecuteN/A

Multiexcerpt include macro
nameTemporary Files
pageJoin

Examples

Deduplicating the List of Childhood Centers in Chicago

...