Versions Compared

Old Version 8

changes.mady.by.user Lakshmi Manda

Saved on

compared with

New Version Current

changes.mady.by.user Kalpana Malladi

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Field Name

Field Type

Description

Label*

 

Default Value: Parquet Parser
Example: Transform Parquet Parser

String

Specify the name for the Snap. You can modify this to be more specific, especially if you have more than one of the same Snap in your pipeline.

 

Ignore empty data

 

Default Value: Selected

Checkbox

When you select this checkbox, the Snap does not generate any output. If you deselect this checkbox, the Snap generates an empty output document when you pass either an empty input stream or an input stream with CSV headers.

Snap execution

Default Value: Validate & Execute
Example: Execute only

Dropdown list

Select one of the following three modes in which the Snap executes:

  • Validate & Execute: Performs limited execution of the Snap, and generates a data preview during pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during pipeline runtime.

  • Execute only: Performs full execution of the Snap during Pipeline execution without generating preview data.

  • Disabled: Disables the Snap and all Snaps that are downstream from it.

...

Code Block
[
  {
    "schemaMap": {
      "AUTOSYNC_PRIMARYKEY": {
        "logicalType": "STRING",
        "repetition": "OPTIONAL",
        "primitiveType": "BINARY",
        "typeLength": 0
      },
      "AUTOSYNC_VALUEHASH": {
        "logicalType": "STRING",
        "repetition": "OPTIONAL",
        "primitiveType": "BINARY",
        "typeLength": 0
      },
      "AUTOSYNC_CURRENTRECORDFLAG": {
        "logicalType": "STRING",
        "repetition": "OPTIONAL",
        "primitiveType": "BINARY",
        "typeLength": 0
      },
      "AUTOSYNC_EFFECTIVEBEGINTIME": {
        "logicalType": "TIMESTAMP(MILLIS,true)",
        "repetition": "OPTIONAL",
        "primitiveType": "INT64",
        "typeLength": 0
      },
      "AUTOSYNC_EFFECTIVEENDTIME": {
        "logicalType": "TIMESTAMP(MILLIS,true)",
        "repetition": "OPTIONAL",
        "primitiveType": "INT64",
        "typeLength": 0
      },
      "ID1": {
        "logicalType": null,
        "repetition": "OPTIONAL",
        "primitiveType": "DOUBLE",
        "typeLength": 0
      },
      "ID2": {
        "logicalType": "STRING",
        "repetition": "OPTIONAL",
        "primitiveType": "BINARY",
        "typeLength": 0
      },
      "ID3": {
        "logicalType": "STRING",
        "repetition": "OPTIONAL",
        "primitiveType": "BINARY",
        "typeLength": 0
      },
      "ID4": {
        "logicalType": "STRING",
        "repetition": "OPTIONAL",
        "primitiveType": "BINARY",
        "typeLength": 0
      },
      "ID5": {
        "logicalType": "STRING",
        "repetition": "OPTIONAL",
        "primitiveType": "BINARY",
        "typeLength": 0
      },
      "ID6": {
        "logicalType": "STRING",
        "repetition": "OPTIONAL",
        "primitiveType": "BINARY",
        "typeLength": 0
      },
      "ID7": {
        "logicalType": "STRING",
        "repetition": "OPTIONAL",
        "primitiveType": "BINARY",
        "typeLength": 0
      },
      "ID8": {
        "logicalType": null,
        "repetition": "OPTIONAL",
        "primitiveType": "BINARY",
        "typeLength": 0
      },
      "ID9": {
        "logicalType": null,
        "repetition": "OPTIONAL",
        "primitiveType": "DOUBLE",
        "typeLength": 0
      },
      "ID10": {
        "logicalType": null,
        "repetition": "OPTIONAL",
        "primitiveType": "DOUBLE",
        "typeLength": 0
      },
      "ID11": {
        "logicalType": null,
        "repetition": "OPTIONAL",
        "primitiveType": "DOUBLE",
        "typeLength": 0
      },
      "ID12": {
        "logicalType": null,
        "repetition": "OPTIONAL",
        "primitiveType": "DOUBLE",
        "typeLength": 0
      },
      "ID13": {
        "logicalType": null,
        "repetition": "OPTIONAL",
        "primitiveType": "DOUBLE",
        "typeLength": 0
      },
      "ID14": {
        "logicalType": null,
        "repetition": "OPTIONAL",
        "primitiveType": "DOUBLE",
        "typeLength": 0
      },
      "ID15": {
        "logicalType": "DATE",
        "repetition": "OPTIONAL",
        "primitiveType": "INT32",
        "typeLength": 0
      },
      "ID16": {
        "logicalType": "TIMESTAMP(MILLIS,true)",
        "repetition": "OPTIONAL",
        "primitiveType": "INT64",
        "typeLength": 0
      },
      "ID17": {
        "logicalType": "TIMESTAMP(MILLIS,true)",
        "repetition": "OPTIONAL",
        "primitiveType": "INT64",
        "typeLength": 0
      },
      "ID18": {
        "logicalType": "TIMESTAMP(MILLIS,true)",
        "repetition": "OPTIONAL",
        "primitiveType": "INT64",
        "typeLength": 0
      },
      "ID100": {
        "logicalType": null,
        "repetition": "OPTIONAL",
        "primitiveType": "DOUBLE",
        "typeLength": 0
      }
    },
    "schema": "message document {\n  optional binary AUTOSYNC_PRIMARYKEY (STRING);\n  optional binary AUTOSYNC_VALUEHASH (STRING);\n  optional binary AUTOSYNC_CURRENTRECORDFLAG (STRING);\n  optional int64 AUTOSYNC_EFFECTIVEBEGINTIME (TIMESTAMP(MILLIS,true));\n  optional int64 AUTOSYNC_EFFECTIVEENDTIME (TIMESTAMP(MILLIS,true));\n  optional double ID1;\n  optional binary ID2 (STRING);\n  optional binary ID3 (STRING);\n  optional binary ID4 (STRING);\n  optional binary ID5 (STRING);\n  optional binary ID6 (STRING);\n  optional binary ID7 (STRING);\n  optional binary ID8;\n  optional double ID9;\n  optional double ID10;\n  optional double ID11;\n  optional double ID12;\n  optional double ID13;\n  optional double ID14;\n  optional int32 ID15 (DATE);\n  optional int64 ID16 (TIMESTAMP(MILLIS,true));\n  optional int64 ID17 (TIMESTAMP(MILLIS,true));\n  optional int64 ID18 (TIMESTAMP(MILLIS,true));\n  optional double ID100;\n}\n"
  }
]

...

Example

To understand the function of Parquet Parser Snap, refer to the example: , Transform Document Data into Parquet Format and Vice Versa.

Downloads

Info

  1. Download and import the Pipeline into SnapLogic.

  2. Configure Snap accounts, as applicable.

  3. Provide Pipeline parameters, as applicable.

Attachmentspatterns*.slp, *.zipsortByname

Snap Pack History

Insert excerpt
Transform Snap Pack
Transform Snap Pack
nopaneltrue

...