Use this Snap to hide sensitive information in your dataset before exporting the dataset for analytics. By using the Mask Snap, you can ensure sensitive data protection by using masking algorithms that the Snap provides out of the box.
Troubleshooting
None
Snap Input and Output
Input/Output
Type of View
Number of Views
Compatible Upstream and Downstream Snaps
Description
Input
Document
Min: 1
Max: 1
Mapper Snap
MySQL - Select
REST Get
A dataset where some of the data must be masked.
Output
Document
Min: 1
Max: 1
MySQL - Insert
JSON Formatter
CSV Formatter
A dataset where the specified data is masked.
Snap Settings
Parameter Name
Data Type
Description
Default Value
Example
Label
String
Required. The name for the Snap. Modify this to be more specific, especially if there is more than one of the same Snap in the Pipeline.
N/A
Mask
Mask Policy
N/A
Required. Enablesyou to specify the policies that you want to use to mask data in the input dataset.
N/A
N/A
Field
String
The field/parent field in the input dataset that contains the data to be masked.
N/A
name
Search Mode
N/A
The mode the Snap must use to search sensitive data.
Selectfrom the following options:
Exact Path: The Snap searches for the exact field name.
Recursive: The Snap searches through all the levels in the nested structure of thespecified Field.
For example, if you want to mask$credit_card field, you must enter$credit_cardinFieldforExact Path Search Mode. However, if you are using theRecursiveoption as theSearch Mode, then you can just enter$inField.
N/A
Exact Path
Match Field
String
The type of field in the input data to be matched. Select from the following options:
Key: Select if the data to be matched is the field name.
Value: Select if the data to be matched is the field value.
The Snap fails to validate if the Match Field is Key and the Mask Field is also Key. In such a case, select Value as the Mask Field.
N/A
Value
Match Condition
N/A
The match condition that determines whether theMatch Fieldshould be matched. For example, if your input dataset contains $credit_cardFieldand you enter the Match Field as Value and Match Condition as Number, then the Snap masks all $credit_card fields that contain a number as the value. If the field contains text as the value, then the Snap skips maskingthat value.
Select from the following options:
Regex Match: Matches theKeyorValuewhen the key or value is the expression entered inMatch Pattern. IfMatch Patternis blank, the Snap matches all values.
Credit Card: Matches theKeyorValuewhen the key or value is the number pattern used in major credit cards. The supported credit card types are: Visa, MasterCard, JCB, American Express, Discover, and Diner's Club.
The Snap supports both long digits or groups of 4-digits that are separated by a dash or space. For example, 4111 1111 1111 1111, 3589-0731-0185-9601, and 6011000000000004.
SSN: Matches theKeyorValueif the key or value is in the Social Security Number (SSN) pattern. The Snap supports values entered in the SSN format only, which is, XXX-YY-ZZZZ. You can use blanks or dashes as separators. For example, 123-12-1234 and 123 12 1234.
Number: Matches theValuewhen the value is an integer or decimal.
Number (Text): Matches theKeyorValuewhen the key or value is a number in text format. The Snap does not support commas within the number text.
Date: Matches theValuewhen the value is a date object.
Date (Text): Matches theKeyorValuewhen the key or value isa date in textor a pattern entered inMatch Pattern. You can specify the format inMatch Pattern. The Snap supports the following formats:
"2018-08-12"
"2018-08-12T12:34:56"
"2018/08/12 12:34:56.780"
"2018/08/12 12:34:56.78"
"2018-08-12T12:34:56.78"
"2018-08-12 12:34:56"
N/A
Date
Match Pattern
String
The expression of the information pattern to be matched in the input dataset.This is applicable only when theMatch ConditionisRegex MatchorDate (Text).
N/A
Hello
Mask Field
N/A
Thefieldthat contains sensitive data and will be masked if the matching conditions are met. Select from the following options:
Key: Select if the data to be masked is the key.
Value: Select if the data to be masked is the value.
The Snap fails to validate if the Match Field is Key and the Mask Field is also Key. In such a case, select Value as the Mask Field.
N/A
Value
Mask Method
N/A
The method to use to mask sensitive information. Select from the following options:
Replace: Replaces the matched Valuewith the value you enter inMask Value.
Shuffle: Shuffles the matched data Valuerandomly.
Remove: Removes the matchedKeyorValue.
If theMask FieldisValue, the Snap returns null as the new value. If theMask FieldisKey, the Snap removes the wholeKey-Valuepair.
With arrays andRecursiveSearch Mode, if theMask FieldisValue, the value is removed from the array. If all values are removed, the Snap returns an empty array. However, if theMask FieldisKeyand the Snap removes the array along with the key.
Random: Replaces the matchedValuewith a new random value. The Snap derives the random value based on the data type of the matched value and behaves as described below:
Text: Randomly replaces the value with alphanumeric characters having the same length as the original data.
Integer: Randomly replaces the value with an integer value in the range between 0 to an integer of the same digit as the actual data. The new value is always different from the original value. For example, if the original data is 120, the possible replacement value is between 0 to 999, except for 120.
Decimal: Randomly replaces the value with a value that is based on the precision of the original value from 0 to the precision on the same digit. For example, if the original value is 0.023, the possible replacement value is between 0.000 to 0.099, except for 0.023.
Boolean: Randomly replaces the value with either true or false.
Start of Month: Replaces the matched Value with the first day of the month. If the value isa text, the Snap converts the text to date using the same way as theAutomodein theType ConverterSnap. In this mode, the Snap automatically converts text to Date.
Start of Year: Replaces the matched Valuewith the first day of thesameyear. If the value isa text, the Snap converts the text to date using the same way as theAutomode in theType ConverterSnap. In this mode, the Snap automatically converts text to Date.
N/A
Remove
Mask Value
String
Numeric
The value that must replace the sensitive information in the input dataset. You can entereither a fixed value oran expression.This is applicable only when theMask MethodisReplace.
N/A
0
Execute during preview
N/A
Specify the execution type from the following options:
Validate & Execute: Performs limited execution of the Snap (up to 50 records) during Pipeline validation; performs full execution of the Snap (unlimited records) during Pipeline execution.
Execute only: Performs full execution of the Snap during Pipeline execution; does not execute the Snap during Pipeline validation.
Disabled: Disables the Snap and, by extension, its downstream Snaps.
Updated and certified against the current SnapLogic Platform release.
February 2024
436patches25781
Latest
Enhanced the Deduplicate Snap to honor an interrupt while waiting in the delay loop to manage the memory efficiently.
February 2024
main25112
Stable
Updated and certified against the current SnapLogic Platform release.
November 2023
main23721
Nov 8, 2023
Stable
Updated and certified against the current SnapLogic Platform release.
August 2023
main22460
Aug 16, 2023
Stable
Updated and certified against the current SnapLogic Platform release.
May 2023
433patches21572
Latest
The Deduplicate Snap now manages memory efficiently and eliminates out-of-memory crashes using the following fields:
Minimum memory (MB)
Minimum free disk space (MB)
May 2023
433patches21247
Latest
Fixed an issue with the Match Snap where a null pointer exception was thrown when the second input view had fewer records than the first.
May 2023
main21015
Stable
Upgraded with the latest SnapLogic Platform release.
February 2023
main19844
Stable
Upgraded with the latest SnapLogic Platform release.
December 2022
431patches19268
Latest
The Deduplicate Snap now ignores fields with empty strings and whitespaces as no data.
November 2022
main18944
Stable
Upgraded with the latest SnapLogic Platform release.
August 2022
main17386
Stable
Upgraded with the latest SnapLogic Platform release.
4.29
main15993
Stable
Upgraded with the latest SnapLogic Platform release.
4.28
main14627
Stable
Enhanced the Type Converter Snap with the Fail safe upon execution checkbox. Select this checkbox to enable the Snap to convert data with valid data types, while ignoring invalid data types.
4.27
427patches13730
Enhanced the Type Converter Snap with the Fail safe upon executioncheckbox. Select this checkbox to enable the Snap to ignore invalid data types and convert data with valid data types.
4.27
427patches13948
Latest
Fixed an issue with the Principal Component Analysis Snap, where a deadlock occurred when data is loaded from both the input views.
4.27
main12833
Stable
Upgraded with the latest SnapLogic Platform release.
4.26
main11181
Stable
Upgraded with the latest SnapLogic Platform release.
4.25
425patches10994
Fixed an issue when the Deduplicate Snap where the Snap breaks when running on a locale that does not format decimals with Period (.) character.
4.25
main9554
Stable
Upgraded with the latest SnapLogic Platform release.
4.24
main8556
Stable
Upgraded with the latest SnapLogic Platform release.
4.23
main7430
Stable
Upgraded with the latest SnapLogic Platform release.
4.22
main6403
Stable
Upgraded with the latest SnapLogic Platform release.
4.21
snapsmrc542
Stable
Introduces the Mask Snap that enables you to hide sensitive information in your dataset before exporting the dataset for analytics or writing the dataset to a target file.
Enhances theMatch Snap to add a new field,Match all, which matches one record from the first input with multiple records in the second input. Also, enhances theComparatorfield in the Snap by adding one more option,Exact, which identifies and classifies a match as either an exact match or not a match at all.
Enhances the DeduplicateSnap to add a new field,Group ID, which includes the Group ID for each record in the output. Also, enhances theComparatorfield in the Snap by adding one more option,Exact, which identifies and classifies a match as either an exact match or not a match at all.
Enhances the SampleSnap by adding a second output view which displays data that is not in the first output. Also, a new algorithm type,Linear Split, which enables you to split the dataset based on the pass-through percentage.
4.20 Patch
mldatapreparation8771
Latest
Removes the unused jcc-optionaldependency from the ML Data Preparation Snap Pack.
4.20
snapsmrc535
Stable
Upgraded with the latest SnapLogic Platform release.
4.19
snapsmrc528
Stable
New Snap: Introducing the Deduplicate Snap. Use this Snap to remove duplicate records from input documents. When you use multiple matching criteria to deduplicate your data, it is evaluated using each criterion separately, and then aggregated to give the final result.
4.18
snapsmrc523
Stable
Upgraded with the latest SnapLogic Platform release.
4.17 Patch
ALL7402
Latest
Pushed automatic rebuild of the latest version of each Snap Pack to SnapLogic UAT and Elastic servers.
4.17
snapsmrc515
Latest
New Snap: Introducing the Feature Synthesis Snap, which automatically createsfeatures out of multiple datasets that share a one-to-one or one-to-many relationship with each other.
New Snap: Introducing the Match Snap, which enables you to automatically identify matched records across datasets that do not have a common key field.
Added the Snap Execution field to all Standard-mode Snaps. In some Snaps, this field replaces the existing Execute during preview check box.
4.16
snapsmrc508
Stable
Added a new Snap, Principal Component Analysis, which enables you to perform principal component analysis (PCA) on numeric fields (columns) to reduce dimensions of the dataset.
4.15
snapsmrc500
Stable
New Snap Pack. Perform preparatory operations on datasets such as data type transformation, data cleanup, sampling, shuffling, and scaling. Snaps in this Snap Pack are: