Type Inspector

This page is no longer maintained (). For the most current information, go to Type Inspector.

On this Page

Overview

The Type Inspector Snap analyzes the data types in a datasetThis Snap is useful when your data contains multiple data types and you want to recognize the type of every input data. Also, with the aggregate option of the Snap, you can get a count of each data type present in the input.

Input and Output

  • Expected input: A document stream.
  • Expected outputA document that contains information about data types.
  • Expected upstream Snaps: Any Snap that has a document output stream. For example, Mapper, Categorial to Numerical, etc.
  • Expected downstream Snaps: Any Snap that has a document input stream. For example, Unique, JSON Formatter, etc.

Prerequisites

None

Configuring Accounts

Accounts are not used with this Snap.

Configuring Views

Input

This Snap has exactly one document input view.

OutputThis Snap has exactly one document output view.
ErrorThis Snap has at most one document error view.

Troubleshooting

None

Limitations and Known Issues

None

Modes

  • Ultra Pipelines: Works in Ultra Pipelines only when you do not select Aggregate property.


Snap Settings


LabelThe name for the Snap. You can modify this to be specific, especially if you have more than one of the same Snap in your pipeline.
Full class name

Select to output the full class name instead of the shorter one.

Default value: Not selected.

For example, java.math.BigInteger is the full class name of BigInteger.

Aggregate

Select to display the aggregated count of each data type for each field.

Default value: Not selected


Example


Analyzing Data Types

This pipeline demonstrates how to analyze the different data types in the input using the Type Inspector Snap. We also get their full class names with the count of each data type. 

You have an input dataset with different data types which is passed to two Type Inspector Snaps. The first Type Inspector Snap has just the default configuration and analyzes the data types that are present in the dataset. The second Type Inspector Snap lists the data types along with the full class name and the aggregated count of each data type.

Download this pipeline.

 Understanding the pipeline

The input is a JSON document generated by the JSON Generator Snap and contains fields of various data types. The output data preview is as follows:

The dataset from the JSON Generator Snap is sent to two Type Inspector Snaps. The first Type Inspector Snap is configured as follows:

The second Type Inspector Snap is configured as follows:

The first Type Inspector Snap replaces the values with their types and the output preview is as follows:

For the second Type Inspector Snap, based on the configuration, the output contains the full class names of the data types in an aggregated form which tells the number of values in each type:

Download this pipeline.

Snap Pack History

 Click to view/expand
ReleaseSnap Pack VersionDateTypeUpdates
February 2024main25112 StableUpdated and certified against the current SnapLogic Platform release.
November 2023main23721Nov 8, 2023StableUpdated and certified against the current SnapLogic Platform release.

August 2023

main22460

Aug 16, 2023

Stable

Updated and certified against the current SnapLogic Platform release.

May 2023

main21015 

Stable

Upgraded with the latest SnapLogic Platform release.

February 2023432patches19960 Latest

The Profile Snap no longer fails if an input document contains a column or field name that includes a forward slash or a backslash.

February 2023main19844 StableUpgraded with the latest SnapLogic Platform release.
November 2022main18944
 
StableUpgraded with the latest SnapLogic Platform release.
August 2022main17386 StableUpgraded with the latest SnapLogic Platform release.
4.29main15993
 
StableUpgraded with the latest SnapLogic Platform release.
4.28main14627
 
StableUpgraded with the latest SnapLogic Platform release.
4.27 Patch427patches13292
 
Latest

Fixed an issue with the Profile Snap, where the Snap failed to create a temporary directory as the temp file path exceeded 255 characters.

4.274.27 (main12833)
 
StableUpgraded with the latest SnapLogic Platform release.
4.264.26 (main11181)
 
StableUpgraded with the latest SnapLogic Platform release.
4.254.25 (main9554)
 
StableUpgraded with the latest SnapLogic Platform release.
4.24

4.24 (main8556)

  
StableUpgraded with the latest SnapLogic Platform release.
4.234.23 (main7430)
 
StableUpgraded with the latest SnapLogic Platform release.
4.224.22 (main6403)
 
StableUpgraded with the latest SnapLogic Platform release.
4.214.21 (snapsmrc542)
 
StableUpgraded with the latest SnapLogic Platform release.
4.204.20 Patch mlanalytics8769
 
Latest

Removed the unused jcc-optional dependency from the ML Analytics Snap Pack. 

4.204.20 (snapsmrc535)
 
StableUpgraded with the latest SnapLogic Platform release.
4.194.19 (snapsmrc528)
 
StableUpgraded with the latest SnapLogic Platform release.
4.184.18 (snapsmrc523)
 
StableUpgraded with the latest SnapLogic Platform release.
4.174.17patch ALL7402
 
LatestUpgraded with the latest SnapLogic Platform release.
4.174.17 (snapsmrc515)
 
Stable
  • Added the Snap Execution field to all Standard-mode Snaps. In some Snaps, this field replaces the existing Execute during preview checkbox.
  • Profile Snap: Added an optional second output view. When enabled, this outputs a graphical representation of the Snap's first output as a HTML file.
4.16

4.16 (snapsmrc508)

 
Stable

Upgraded with the latest SnapLogic Platform release.

4.15

4.15 (snapsmrc500)

 
Stable
  • New Snap Pack. Perform analytic operations such as data profiling. Snaps in this Snap Pack are:
    • Profile
    • Type Inspector