...

Cache Pipelines enable you to run pipelines that reference refer to information from a main pipeline.

...

Workflow

1. Create a pipeline or use an existing pipeline that contains data that you want to cache for reference in the main pipeline.

2. Set the pipeline path to the pipeline created and specify an alias for the cached data.

3. Create a main pipeline.

4. Add a mapper that retrieves data from the cache specified in Step 3.

5. Run the main pipeline.

Build Cache Pipelines

1. Open Designer and create a new pipeline. This pipeline generates data that has to be referenced in the main pipeline.

2. Use Snaps to move data to the cache. Ensure the following:

   • The final output document needs to have a flattened structure.

   • The pipeline does not have an open input view. You can include a Mapper Snap to restrict the data in your cache or apply transformations based on specific requirements.

3. Click to validate the pipeline.

4. Click to open the Data Preview to verify the data that is stored in the cache.

Design the Main Pipeline

Main pipelines reference the information data in the cache pipeline. You can reference multiple main pipelines.

1. In the Designer tab:

   Click your user name

   in

   on the top

   banner

   right corner of the Designer tab.

2. In the dropdown list, click User Settings.

3. In the Settings dialog,

   under

   set the Preview Document Count

   , set the number of records

   . You can one of the options (1, 2, 10. 50,100, 500, 1000, 11500, 2000) from the dropdown. This value

   is

   sets the

   same

   limit for

   the number of

   records allowed

   for

   in the expression language lookup during validation.

4. Click Save.

5. Create or import a pipeline onto the Designer canvas.

6. Click to open the Edit Pipeline dialog.

7. Fill out the form:in the required details in the Edit Pipeline dialog.

   • Label

   .

   • : Enter a name for your main pipeline. We recommend that you choose a label that’s easily recognizable as the pipeline.

   • Project

   .

   • : Confirm

   that

   • the

   pipeline is the

   • correct project for the pipeline. If you need to change the Project, refer to Moving a Pipeline.

   • Resumable Mode. Leave deselected.

   • Error Pipeline. Leave

   blank

   • empty.

   • Error Pipeline Parameters: Leave empty

   • Parameters: Enter Pipeline Parameters

   • Capture: Select to proliferate parameters downstream.

   Expression

   • Expression Libraries: Add libraries as needed.

8. In Cache Pipelines properties, click to enter the value in the alias Alias and the pipeline Pipeline properties to run for the data stored in that alias. This is These values run for the data stored in that alias, serving as the first argument in the Cache Pipelines expression language functions /wiki/spaces/DRWIP/pages/2977497147 as a reference.

   Image RemovedImage Added

9. Click Save.

Build Cache Pipelines

1. In Designer, create a new pipeline that will generate data to be referenced in the main pipeline.

2. Use any Snaps you need to get the data to cache, ensuring the following:

   • The final output document needs to have a flattened structure.

   • The pipeline does not have an open input view.

3. Optionally, end with a Mapper Snap to restrict the data in your cache or apply transformations for different needs as desired.

4. Click to run pipeline validation.

5. Click to open the Data Preview to verify the data that is stored in the cache.