Dashboard Pipeline Wall

Overview

You can access the Pipeline Wall from the SnapLogic Dashboard. The Pipeline Wall enables you to view details of all the pipelines executed within the Org. Organized into two sections, the Pipeline Wall separates all executing pipelines from those that have completed execution. For each pipeline, the Pipeline Wall shows you a series of details, such as the pipeline name, the username of the user who executed it, and the Snaplex and node in which the Pipeline was executed. Refer to Monitoring Ultra Pipeline Tasks in the SnapLogic Dashboard for specific details about Ultra Task Pipelines.

Additionally, you can check execution statistics for a Pipeline, view associated run logs, and search for a pipeline using its name, username, Snaplex, and values of pipeline and error pipeline parameters. 

Pipelines may not be ordered by timestamp on initial load.

Pipeline Wall

The Pipeline Wall comprises two sections:

  • Executing Pipelines. Displays all pipelines that are either queued to execute or being executed.

  • Pipeline Execution History. Displays all pipelines that either completed execution (successfully or with errors) or were stopped manually.

By default, the sections are titled Executing Pipelines of My Executions and Pipeline Execution History of My Executions.

For Org admins, the sections are titled Executing Pipelines of All Projects and Pipeline Execution History of All Projects.

The section titles vary depending on the value you select for Show Only. For example, if you select shared, the titles read Executing Pipelines of shared and Pipeline Execution History of shared, respectively.

 

When a user owns Executing pipelines (where an OAuth2 account is being used), and their privileges are revoked on those Assets, those pipelines need to be Stopped and Restarted.

  • Enter the Username in the search field of the Executing Pipelines pane to display all pipelines executed by the user.

  • Stop the pipelines where an OAuth2 account is being used. You can stop all Ultra-task pipelines. The decision to pause any Triggered or Scheduled tasks is based on the duration of the related pipelines.

The Pipeline Wall enables you to:

Generate Reports

To generate a CSV-formatted report of all the Pipelines displayed on the Pipeline Wall, click the Download CSV button.

The CSV file contains the following information:

  • Pipeline Link

  • Pipeline Name

  • Username

  • Snaplex

  • Status

  • Time Started

  • Duration

  • Document Count

  • We calculate the Pipeline execution Duration displayed in the SnapLogic Dashboard > Pipeline tab as the completion time minus the Pipeline’s start time. Previously, the duration calculation also included the prepare state before the Pipeline start time: the time it took for the Snaplex to communicate with the Control Plane. With this change, we remove the variable of network latency from the calculation, making the Duration metric more accurate.

  • You can download up to 10,000 records of the pipeline execution data for the past 45 days duration.

Filter by Date/Time Range

To filter the results by time, you can choose one of the default time ranges:

  • 1 Hr: Retrieve Pipelines executed in the past 1 hour.

  • 8 Hrs: Retrieve Pipelines executed in the past 8 hours.

  • 24 Hrs: Retrieve Pipelines executed in the past 24 hours.

To filter the results by a custom date range, enter dates in the Start and End fields.

Filter by Pipeline Attribute

You can filter Pipelines based on a combination of any of the Pipeline attributes, which you can select using UI controls on the Pipeline Wall.

UI Control

Description

UI Control

Description

Search box

Filters the results based on the search string you specify. The search string is compared with the following attributes:

Invocation type

Filters the results based on the method of invocation. You can choose from the following options:

  • All

  • API Calls: Pipelines executed as a Triggered task.

  • Schedule: Pipelines executed as a Scheduled task.

  • Ultra: Pipelines executed as an Ultra task.

  • Manual: Manually executed Pipelines.

  • For Each: Pipelines executed by the For Each Snap.

  • Nested: Pipelines executed by the Pipeline Execute Snap.

An icon next to the Pipeline indicates its invocation type.

  • Scheduled Task

  • Triggered Task

  • Ultra Task

  • Manually executed Pipeline

  • Nested Pipeline

Show Only

Filters the results based on the project space. Select a space from the dropdown to return only Pipelines in that space.

Group Pipelines

If selected, displays the parent and child Pipelines in a hierarchical tree. If one Pipeline calls another, a plus sign (+) appears next to the parent Pipeline. You can click on the plus sign to see the child Pipelines that the parent calls.

Child Pipelines

When you select the Group Pipelines checkbox, the Dashboard displays the first 100 most recent Pipeline runs of the parent Pipeline. If you deselect Group Pipelines, the Dashboard displays data for up to 500 of the most recent child Pipeline runs, even if the parent has more than 500 children. Because the Dashboard also limits the historical view to 45 days, the number of viewable Pipelines might not reach 500. You can view Pipeline runs that occurred prior to the 45-day limit in the Runtime Archive.

Status

Filters the results based on the execution status of the Pipeline. The options vary between two sections.

In the Executing Pipelines section:

  • All

  • Queued

  • Started

  • Prepared

  • Stopping

  • Failing

  • Suspending

  • Suspended

  • Resuming

In the Pipeline Execution History section:

  • All

  • Stopped

  • Failed

  • Completed