...
Overview
You can use this Snap to execute a job, check its status in Databricks, and, based on the job's status, complete or fail the pipeline. The Snap triggers the task to execute and then periodically checks its statusautomate the execution of a set of tasks or processes within a Databricks workspace. It triggers the task and periodically checks its progress. The Snap stops after the job is executed. Howevercomplete, but if you cancel the pipeline is canceled before the task is finishedfinishes, the Snap requests to stop terminate the task.
...
Example
Run Job on a Cluster
...
The following example pipeline demonstrates how to run a job specified in the notebook on a cluster.
...
Step 1: Configure the Databricks - Run Job Snap with the following settings:
...
Attachments | ||
---|---|---|
|
Snap Pack History
Expand | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
|