Skip to end of banner
Go to start of banner

Principal Component Analysis

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

Overview

This Snap performs Principal Component Analysis (PCA) on an input document and outputs a document containing fewer dimensions (or columns). The first dimension in the output document accounts for as much of the variability in the data as possible, and each succeeding dimension accounts for as much of the remaining variability as possible. Thus, when you reduce the number of dimensions, you significantly reduce the amount of data that the downstream Snap must manage, making it faster.

Principal Component Analysis (PCA) is a dimension-reduction tool that can be used to reduce a large set of variables to a small set that still contains most of the information in the original set.


Input and Output

  • Expected input: A document containing data that has numeric fields.
  • Expected output: A document containing transformed data with fewer (lower) dimensions.
  • Expected upstream Snaps: Any Snap that offers a document. For example, a combination of File Reader and CSV Parser, or Mapper.
  • Expected downstream Snaps: Any Snap that accepts a document. For example, Mapper or CSV Formatter.

Prerequisites

  • The data from upstream Snap must be in tabular format (no nested structures). 

Configuring Accounts

Accounts are not used with this Snap.

Configuring Views

Input

This Snap has at most two document input views.
OutputThis Snap has at most two document output views.
ErrorThis Snap has at most one document error view.

Troubleshooting

None.

Limitations and Known Issues

None.

Modes

  • Ultra pipelines: Works in Ultra pipelines when the Snap has two input views and one output view.
  • Spark mode: Does not work in Spark mode.



Snap Settings


LabelRequired. The name for the Snap. Modify this to be more specific, especially if there are more than one of the same Snap in the pipeline.
Dimension

Required. The maximum number of dimensions–or columns–that you want in the output.

Minimum value: 0

Maximum value: Undefined

Default value: 10

Variance

Required. The minimum variance that you want to keep in the output document.

Minimum value: 0

Maximum value: 1

Default value: 0.95

Pass through
Select this check box to include all the categorical input fields in the output.


Downloads

  File Modified
You are not logged in. Any changes you make will be marked as anonymous. You may want to Log In if you already have an account.
No files shared here yet.
  • Drag and drop to upload or browse for files


  • Snap History


    Snap Pack History

     Click to view/expand
    Release Snap Pack VersionDateType  Updates
    May 2024main26341 StableUpdated and certified against the current SnapLogic Platform release.
    February 2024436patches25781 Latest

    Enhanced the Deduplicate Snap to honor an interrupt while waiting in the delay loop to manage the memory efficiently.

    February 2024main25112 StableUpdated and certified against the current SnapLogic Platform release.
    November 2023main23721Nov 8, 2023StableUpdated and certified against the current SnapLogic Platform release.

    August 2023

    main22460

    Aug 16, 2023

    Stable

    Updated and certified against the current SnapLogic Platform release.

    May 2023433patches21572 Latest

    The Deduplicate Snap now manages memory efficiently and eliminates out-of-memory crashes using the following fields:

    • Minimum memory (MB)

    • Minimum free disk space (MB)

    May 2023433patches21247 Latest

    Fixed an issue with the Match Snap where a null pointer exception was thrown when the second input view had fewer records than the first.

    May 2023

    main21015 

    Stable

    Upgraded with the latest SnapLogic Platform release.

    February 2023main19844 StableUpgraded with the latest SnapLogic Platform release.
    December 2022431patches19268 Latest

    The Deduplicate Snap now ignores fields with empty strings and whitespaces as no data.

    November 2022main18944
     
    Stable

    Upgraded with the latest SnapLogic Platform release.

    August 2022main17386
     
    Stable

    Upgraded with the latest SnapLogic Platform release.

    4.29main15993
     
    StableUpgraded with the latest SnapLogic Platform release.
    4.28main14627
     
    Stable

    Enhanced the Type Converter Snap with the Fail safe upon execution checkbox. Select this checkbox to enable the Snap to convert data with valid data types, while ignoring invalid data types.

    4.27427patches13730

    Enhanced the Type Converter Snap with the Fail safe upon execution checkbox. Select this checkbox to enable the Snap to ignore invalid data types and convert data with valid data types.

    4.27427patches13948
     
    Latest

    Fixed an issue with the Principal Component Analysis Snap, where a deadlock occurred when data is loaded from both the input views.

    4.27main12833
     
    StableUpgraded with the latest SnapLogic Platform release.
    4.26main11181
     
    StableUpgraded with the latest SnapLogic Platform release.
    4.25425patches10994
     

    Fixed an issue when the Deduplicate Snap where the Snap breaks when running on a locale that does not format decimals with Period (.) character. 

    4.25main9554
     
    StableUpgraded with the latest SnapLogic Platform release.
    4.24main8556
     
    StableUpgraded with the latest SnapLogic Platform release.
    4.23main7430
     
    StableUpgraded with the latest SnapLogic Platform release.
    4.22main6403
     
    StableUpgraded with the latest SnapLogic Platform release.
    4.21snapsmrc542
     
    Stable
    • Introduces the Mask Snap that enables you to hide sensitive information in your dataset before exporting the dataset for analytics or writing the dataset to a target file.
    • Enhances the Match Snap to add a new field, Match all, which matches one record from the first input with multiple records in the second input. Also, enhances the Comparator field in the Snap by adding one more option, Exact, which identifies and classifies a match as either an exact match or not a match at all.
    • Enhances the Deduplicate Snap to add a new field, Group ID, which includes the Group ID for each record in the output. Also, enhances the Comparator field in the Snap by adding one more option, Exact, which identifies and classifies a match as either an exact match or not a match at all.
    • Enhances the Sample Snap by adding a second output view which displays data that is not in the first output. Also, a new algorithm type, Linear Split, which enables you to split the dataset based on the pass-through percentage.
    4.20 Patchmldatapreparation8771
     
    Latest

    Removes the unused jcc-optional dependency from the ML Data Preparation Snap Pack.

    4.20snapsmrc535
     
    StableUpgraded with the latest SnapLogic Platform release.
    4.19snapsmrc528
     
    Stable

    New Snap: Introducing the Deduplicate Snap. Use this Snap to remove duplicate records from input documents. When you use multiple matching criteria to deduplicate your data, it is evaluated using each criterion separately, and then aggregated to give the final result.

    4.18snapsmrc523
     
    StableUpgraded with the latest SnapLogic Platform release.
    4.17 PatchALL7402
     
    Latest

    Pushed automatic rebuild of the latest version of each Snap Pack to SnapLogic UAT and Elastic servers.

    4.17snapsmrc515
     
    Latest
    • New Snap: Introducing the Feature Synthesis Snap, which automatically creates features out of multiple datasets that share a one-to-one or one-to-many relationship with each other.
    • New Snap: Introducing the Match Snap, which enables you to automatically identify matched records across datasets that do not have a common key field.
    • Added the Snap Execution field to all Standard-mode Snaps. In some Snaps, this field replaces the existing Execute during preview check box.
    4.16snapsmrc508
     
    Stable

    Added a new Snap, Principal Component Analysis, which enables you to perform principal component analysis (PCA) on numeric fields (columns) to reduce dimensions of the dataset.

    4.15snapsmrc500
     
    Stable
    • New Snap Pack. Perform preparatory operations on datasets such as data type transformation, data cleanup, sampling, shuffling, and scaling. Snaps in this Snap Pack are: 
      • Categorical to Numeric
      • Clean Missing Values
      • Date Time Extractor
      • Numeric to Categorical
      • Sample
      • Scale
      • Shuffle
      • Type Converter

    • No labels