Versions Compared
Key
- This line was added.
- This line was removed.
- Formatting was changed.
Overview
Tasks are how pipelines become operational. As a general example, consider the Pipeline designer as a developer, typically with the background of an IT specialist, who constructs Pipelines that fit the data processing needs of an organization. For example, after you build a Pipeline, you then need it to run on a schedule or after an event occurs. Hence, Tasks provide an easy way to do accomplish productionization.
Tasks enable you to execute your pipelines Pipelines by either using a fixed schedule or by accessing a URL. The URL method of execution can also feed data into a pipeline and receive the output of the pipeline. From the Tasks page, you can view what tasks are already available and create new ones. Since the pipelines executed by tasks will be run in an unattended mode, you can receive notifications of activity by specifying a comma-separated list of email addresses.
Info |
---|
If you are on the Tasks page under a project, the list will display what type of task each one is in the Run Policy column. If you are on the project-level page, this column is not available. Image Removed |
Hover over the task name to get access to the context menu. From there, you have access to view the task's activity log to see when it was created or modified.triggering a URL.
- Scheduled Tasks–Choose for the scenario where a job needs to be accomplished starting at a particular time, on an interval, or on a more complex schedule.
- Triggered Tasks–Choose to enable triggering the Pipeline execution through a HTTP call. A Triggered Task can be used to build an endpoint of a Web API and allows passing data into and retrieving data from a Pipeline.
- Ultra Pipeline Tasks–Choose for specialized, low-latency jobs that require continuous ability to process documents. The URL method is similar to Triggered Tasks, but the Pipeline design limits the usage of certain Snaps.
Ultra and Triggered Tasks Compared
The difference between Ultra and Triggered Tasks is that the Ultra Task is a constantly running Pipeline, listening for the new documents streaming in. By the time a document is sent to an Ultra Task, the underlying Pipeline is already prepared and can start processing the document instantly, whereas a Pipeline run through the URL that is created from the Triggered Task has to go through the Pipeline prepare stage first. Depending on a variety of criteria (Pipeline size, accounts and types of Snaps used in the Pipeline), the prepare stage can take time, which makes the Ultra Task usage beneficial when the expected response time is a matter of sub-seconds. Since Ultra Pipelines are always running, they can be used to process documents continually from external sources like message queues. Also, data passed into an Ultra pipeline is more reliably processed.
In terms of Pipeline design, the Ultra Task is more restricting when compared to Triggered Tasks because of the number of unsupported Snaps and restrictions around the input and output Snaps and Pipeline parameters. In addition, the Snaplex on which the Ultra Task runs must have a FeedMaster.
Compatibility Matrix of Tasks and Pipeline Types
Pipeline Mode | Triggered Task | Ultra Task | Scheduled Task |
---|---|---|---|
Standard | Supported | Supported | Supported |
Resumable | Supported | Not Supported | Supported |
eXtreme | Not supported | Not supported | Not supported |
Panel | ||||
---|---|---|---|---|
| ||||
In this Section
|