Snap Execution on Groundplexes and Cloudplexes

Overview

The SnapLogic Platform® offers the flexibility to configure your Snaps on Cloudplex, Groundplex, or both. However, the deployability of Snaps to Cloudplex, Groundplex, or both is determined by the following criteria:

  1. Firewall: When a firewall protects the endpoints, Cloudplex cannot establish a connection. To enable Snap to function with Cloudplex, it is mandatory to whitelist Cloudplex to allow it to interact with these endpoints.

  2. Configuration: Snaps that involve IAM Role configuration are incompatible with Cloudplex. Consequently, such Snaps must be executed on Groundplex to function successfully.

  3. Processes: Snaps that require specific processes to execute, such as sqlldr, bcp, or AZcopy, must be set up within your Groundplex configuration. The SnapLogic Platform does not support the installation of utilities or processes on Cloudplexes.

All Snaps support Groundplex by default. However, a few Snap Packs require you to install specific utilities within your Groundplex configuration to run your pipelines.

Snap Pack

Snaps

Utilities required for Snap Packs in Groundplex configuration

Azure SQL

Azure SQL Bulk - Extract

The Azure SQL Bulk - Extract Snap requires a minimum of SQL Server 2016 and requires the BCP utility program internally to perform the bulk load action.

Binary

File Poller

https://learn.microsoft.com/en-us/rest/api/storageservices/create-service-sas?redirectedfrom=MSDN#specifying-permissions

You must install the AzCopy utility in Snaplex to fetch the file path. If the path is null, the native Azure Storage SDK is used for all operations. Learn more about the AzCopy command.

You must install the utility, only if you use the ABFS (Azure Blob File Storage) file protocol Azure Data Lake Gen 2) for bulk operation.

If AzCopy Utility is not installed for ABS file transfer, the file transfer will not be as fast as using AzCopy because a REST call will be invoked for each file content instead of a bulk operation.

File Reader

File Writer

Directory Browser

File Delete

File Operation

Hadoop

For Hadoop with Kerberos, you must install a few utilities on the Snaplex, such as kinit, kdestroy, and so on.

Additionally the Hadoop Snaps use the Hadoop libraries that invoke a few system programs internally.

Oracle

Oracle - Bulk Load

The Oracle Bulk Load Snap uses Oracle SQL*Loader internally to perform the bulk load action. You must install sqlldr utility for the Snap to run on Groundplex.

SQL Server

SQL Server Bulk Load

This Snap requires the BCP utility program internally to perform the bulk load action.

Tableau

To use these Snaps, Tableau libraries must be available on the Windows, Linux, or IoS-based Snaplex nodes. This means that the Tableau server must have been installed on the server and be available to the Snaplex process. If the Tableau server is not installed, any use of the Tableau Snaps causes server exceptions.

You must install the Tabcmd utility and set up the Tableau Hyper Lib.

Related Links: