Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

On this Page

Table of Contents
maxLevel2
excludeOlder Versions|Additional Resources|Related Links|Related Information

Snap type:

Parse


Description:

This Snap parses RC file data and converts them into documents that can be processed by downstream Snaps.

  • Expected upstream Snaps: The upstream Snap should be a binary data source Snap sourcing an RC File from some data store.
  • Expected downstream Snaps: The RC File Parser outputs table data with columns and rows.  The downstream Snap should be able to parse this information.


Prerequisites:

[None]


Support and limitations:Ultra pipelines: Works in Ultra Pipelines.Spark modNot supported in Spark modeTask Pipelines.
Account: 

Accounts are not used with this Snap.


Views:


InputThis Snap has exactly one binary input view.
OutputThis Snap has exactly one document output view.
ErrorThis Snap has at most one document error view and produces zero or more documents in the view.


Settings

Label


Required. The name for the Snap. You can modify this to be more specific, especially if you have more than one of the same Snap in your pipeline.

Hive Metastore URL


Hive Metastore URI, such as: thrift://localhost:9083

Example: thrift://hive.metastore.com:9083 u

Default value: [None]


Database


Database which holds the schema for the incoming RC File data.
 

Examplehive_db

Default value:  [None]


Table


Table whose schema should be used for parsing the incoming RC file data
 

Examplehive_tbl

Default value [None]


Column definition


Manually configure the column definition for the incoming RC File data.
 

Example

Column Name: Fun column 1 

Column Type: string

Default value [None]


Multiexcerpt include macro
nameSnap Execution
pageAnaplan Read


Multiexcerpt include macro
nameSnap_Execution_Introduced
pageAnaplan Read

  

Troubleshooting

Insert excerpt
Hadoop Directory Browser
Hadoop Directory Browser
nopaneltrue

Insert excerpt
Hadoop Snap Pack
Hadoop Snap Pack
nopaneltrue