Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

In this article

Table of Contents
maxLevel2
absoluteUrltrue

Overview

You must configure accounts in Hadoop Snaps to enable them to connect to Hadoop tables.

In this section

Child pages (Children Display)

Snap Compatibility

Snaps in the Hadoop Snap Pack work with different accounts and protocols per the following table:

SnapAWS S3 Account for HadoopAWS S3 Dynamic AccountAzure Storage for HadoopAzure Data LakeAzure Data Lake Storage Gen 2 OAuth2KerberosProtocols Supported
Hadoop Directory Browser

  • ABFS
  • HDFS
HDFS Reader
  • WASB
  • WASBS
  • ABFS
  • HDFS
  • ADL
HDFS WriterWASB, WASBS, ABFS, HDFS, ADL
HDFS ZipFile ReaderABFS, HDFS
HDFS ZipFile WriterABFS, HDFS
ORC ReaderAWS S3, WASB, WASBS, ABFS, HDFS
ORC WriterAWS S3, ABFS, HDFS
Parquet ReaderAWS S3, WASB, WASBS, ABFS, HDFS, ADL
Parquet WriterAWS S3, WASB, WASBS, ABFS, HDFS, ADL
RC File FormatterRC File ParserSequence FormatterSequence ParserN/A

Configuring Hadoop Accounts

You can configure Hadoop accounts in SnapLogic using either the Designer or Manager.

Using SnapLogic Designer

Selecting an existing account

SnapLogic organizes and displays all accounts to which you have access, sorting them by account type and location. To select an existing account:

  1. Click the  icon to view the accounts to which you have access and select the account that you want to use. 

  2. Click .

Creating an account

  1. Click Add Account in the Account Reference dialog.

  2. Select the Location in which you want to create the account, select the account type, and click ContinueThe Add Account dialog associated with the account type appears.
    Image Modified


  3. Enter the required account details. For detailed guidance on how to provide information associated with each account type, use the following links:

    Child pages (Children Display)

    Info

    Enter additional information on this account in the Notes field of the Info tab. This will help you–and other users–understand the purpose of the account, especially if there are multiple accounts of the same type.


  4. Click Validate to verify the account, if the account type supports validation.

  5. Click Apply to complete configuring the binary account.

Using SnapLogic Manager

Use Manager to create accounts without associating them immediately with Pipelines.

Note

Accounts in SnapLogic are associated with projects. You can use accounts created in other projects only if you have at least Read access to them.

  1. In the left pane, browse to the project in which you want to create the account and click CreateAccount Binary, followed by the appropriate account type.


  2. The Create Account dialog associated with the selected account type appears. 

  3. Repeat the steps numbered 3 through 5 in the previous section.

Warning

Avoid updating account credentials while Pipelines using that account are executing. This may lead to unexpected results, including locking your account.

Insert excerpt
Hadoop Snap Pack
Hadoop Snap Pack
nopaneltrue