Configuring Hadoop Accounts

Configuring Hadoop Accounts

Snap Compatibility

Snaps in the Hadoop Snap Pack work with different accounts and protocols per the following table:

Snap

Protocols Supported

Hadoop Directory Browser

  • ABFS

  • HDFS

HDFS Reader

  • WASB

  • WASBS

  • ABFS

  • HDFS

  • ADL

HDFS Writer

WASB, WASBS, ABFS, HDFS, ADL

HDFS ZipFile Reader

ABFS, HDFS

HDFS ZipFile Writer

ABFS, HDFS

ORC Reader

AWS S3, WASB, WASBS, ABFS, HDFS

ORC Writer

AWS S3, ABFS, HDFS

Parquet Reader

AWS S3, WASB, WASBS, ABFS, HDFS, ADL

Parquet Writer

AWS S3, WASB, WASBS, ABFS, HDFS, ADL

RC File FormatterRC File ParserSequence FormatterSequence Parser

N/A

Configuring Hadoop Accounts

You can configure Hadoop accounts in SnapLogic using either the Designer or Manager.

Using SnapLogic Designer

Selecting an existing account

SnapLogic organizes and displays all accounts to which you have access, sorting them by account type and location. To select an existing account:

  1. Click the 

     icon to view the accounts to which you have access and select the account that you want to use. 

  2. Click 

    .

Creating an account

  1. Click Add Account in the Account Reference dialog.

  2. Select the Location in which you want to create the account, select the account type, and click ContinueThe Add Account dialog associated with the account type appears.



     

  3. Enter the required account details. For detailed guidance on how to provide information associated with each account type, use the following links:

  4. Click Validate to verify the account, if the account type supports validation.

  5. Click Apply to complete configuring the binary account.

Using SnapLogic Manager

Use Manager to create accounts without associating them immediately with Pipelines.

Accounts in SnapLogic are associated with projects. You can use accounts created in other projects only if you have at least Read access to them.

  1. In the left pane, browse to the project in which you want to create the account and click CreateAccount Binary, followed by the appropriate account type.



  2. The Create Account dialog associated with the selected account type appears. 

  3. Repeat the steps numbered 3 through 5 in the previous section.

Avoid updating account credentials while Pipelines using that account are executing. This may lead to unexpected results, including locking your account.


Related Content