Type Inspector

On this Page

Overview

The Type Inspector Snap analyzes the data types in a datasetThis Snap is useful when your data contains multiple data types and you want to recognize the type of every input data. Also, with the aggregate option of the Snap, you can get a count of each data type present in the input.

Input and Output

  • Expected input: A document stream.
  • Expected outputA document that contains information about data types.
  • Expected upstream Snaps: Any Snap that has a document output stream. For example, Mapper, Categorial to Numerical, etc.
  • Expected downstream Snaps: Any Snap that has a document input stream. For example, Unique, JSON Formatter, etc.

Prerequisites

None

Configuring Accounts

Accounts are not used with this Snap.

Configuring Views

Input

This Snap has exactly one document input view.

OutputThis Snap has exactly one document output view.
ErrorThis Snap has at most one document error view.

Troubleshooting

None

Limitations and Known Issues

None

Modes

  • Ultra Pipelines: Works in Ultra Pipelines only when you do not select Aggregate property.


Snap Settings


LabelThe name for the Snap. You can modify this to be specific, especially if you have more than one of the same Snap in your pipeline.
Full class name

Select to output the full class name instead of the shorter one.

Default value: Not selected.

For example, java.math.BigInteger is the full class name of BigInteger.

Aggregate

Select to display the aggregated count of each data type for each field.

Default value: Not selected

Snap Execution

Select one of the three modes in which the Snap executes. Available options are:

  • Validate & Execute: Performs limited execution of the Snap, and generates a data preview during Pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during Pipeline runtime.
  • Execute only: Performs full execution of the Snap during Pipeline execution without generating preview data.
  • Disabled: Disables the Snap and all Snaps that are downstream from it.


Example


Analyzing Data Types

This pipeline demonstrates how to analyze the different data types in the input using the Type Inspector Snap. We also get their full class names with the count of each data type. 

You have an input dataset with different data types which is passed to two Type Inspector Snaps. The first Type Inspector Snap has just the default configuration and analyzes the data types that are present in the dataset. The second Type Inspector Snap lists the data types along with the full class name and the aggregated count of each data type.

Download this pipeline.

 Understanding the pipeline

The input is a JSON document generated by the JSON Generator Snap and contains fields of various data types. The output data preview is as follows:

The dataset from the JSON Generator Snap is sent to two Type Inspector Snaps. The first Type Inspector Snap is configured as follows:

The second Type Inspector Snap is configured as follows:

The first Type Inspector Snap replaces the values with their types and the output preview is as follows:

For the second Type Inspector Snap, based on the configuration, the output contains the full class names of the data types in an aggregated form which tells the number of values in each type:

Download this pipeline.

Snap Pack History

 Click to view/expand

4.27 (main12833)

  • No updates made.

4.26 (main11181)

  • No updates made.

4.25 (main9554)

  • No updates made.

4.24 (main8556)

  • No updates made.

4.23 (main7430)

  • No updates made.

4.22 (main6403)

  • No updates made.

4.21 (snapsmrc542)

  • No updates made.

4.20 Patch mlanalytics8769

  • Removes the unused jcc-optional dependency from the ML Analytics Snap Pack. 

4.20 (snapsmrc535)

  • No updates made.

4.19 (snapsmrc528)

  • No updates made.

4.18 (snapsmrc523)

  • No updates made.

4.17 Patch ALL7402

  • Pushed automatic rebuild of the latest version of each Snap Pack to SnapLogic UAT and Elastic servers.

4.17 (snapsmrc515)

  • Added the Snap Execution field to all Standard-mode Snaps. In some Snaps, this field replaces the existing Execute during preview check box.
  • Profile Snap: Added an optional second output view. When enabled, this outputs a graphical representation of the Snap's first output as a HTML file.

4.16 (snapsmrc508)

  • No updates made. Automatic rebuild with a platform release.

4.15 (snapsmrc500)

  • New Snap Pack. Perform analytic operations such as data profiling. Snaps in this Snap Pack are:
    • Profile
    • Type Inspector