Adobe Cloud Platform Read

On this Page

ACP Read Snap Deprecation Notice

Since Adobe Cloud Platform (ACP) is deprecated by Adobe, we are replacing the ACP Snap Pack with the Adobe Experience Platform (AEP) Snap Pack starting from 4.22 GA release. Hence, ACP Read Snap is deprecated in 4.22 release. For more information, see the Adobe Experience Platform Read Snap article.

Overview

The Adobe Experience Platform Read Snap is a Read type Snap and can be used to read data sets in the Adobe Experience Platform console using information like Dataset ID for a selected data set schema. The Snap supports reading data sets in the following data set schema:

  • Profile XSD
  • CSV
  • Parquet

The Snap accepts document input and generates a document output. Snaps with document input/output view such as Mapper can be used upstream/downstream of the Snap. 

Prerequisites

Access to Adobe Experience Platform is required in order to be able to use this Snap.

Configuring Accounts

This Snap uses account references created on the Accounts page of SnapLogic Manager to handle access to this endpoint. See Configuring Adobe Experience Platform Accounts for information on setting up this type of account.

Configuring Views

Input

This Snap has at most one document input view.
OutputThis Snap has exactly one document output view.
ErrorThis Snap has at most one document error view and produces zero or more documents in the view.

Limitations and Known Issues

As of its initial release, the Snap supports only Profile XSD, CSV, and Parquet formats.

Modes

Snap Settings


LabelRequired. The name for the Snap. Modify this to be more specific, especially if there are more than one of the same Snap in the pipeline.
Dataset schema

This is a drop-down list that lets the user select the schema of the data set that is to be read. The suggestions in Dataset name and Dataset ID are based on this selection.

The following options are available in this drop-down menu:

  • Profile XSD - If the data set to be read is based on XSD schema.
  • CSV - If the data set to be read is based on CSV schema.
  • Parquet - If the data set to be read is based on Parquet schema.

Default value: Parquet

Dataset name

The name of the data set to be read. This is a suggestible field and will provide names of all the data sets within the Account based on the selection in the Dataset schema property.

Example: doctest

Default value: [None] 

This property is expression-enabled. For more information on the expression language, see Understanding Expressions in SnapLogic and Using Expressions. For information on Pipeline Parameters, see Pipeline Properties.

Dataset ID

Required. The data set ID of the data set to be read. This is a suggestible field and will provide IDs of all the data sets within the Account based on the Dataset schema and Dataset nameproperty's configuration.

Example: 5acdb87f9iqdrac201da2e0e9

Default value: [None]

This property is expression-enabled. For more information on the expression language, see Understanding Expressions in SnapLogic and Using Expressions. For information on Pipeline Parameters, see Pipeline Properties.

Refresh datasets cache

If selected, the Snap will refresh the cache and show refreshed results. This is handy in cases where changes are made to the data set outside of SnapLogic, such as a new data set created, existing data set deleted, and so on. In such cases, enabling this property will refresh the cache and display updated content.

Default value: Not selected.

New data sets

This property is disabled by default to save on unnecessary API calls but it is useful in cases where a new data set is added after the Snap's initial configuration. New data sets will not be visible in the Snap's suggestions unless this property is enabled.

Snap execution

Select one of the three modes in which the Snap executes. Available options are:
  • Validate & Execute: Performs limited execution of the Snap, and generates a data preview during Pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during Pipeline runtime.
  • Execute only: Performs full execution of the Snap during Pipeline execution without generating preview data.
  • Disabled: Disables the Snap and all Snaps that are downstream from it.

Troubleshooting

Snap throws an error when Pipeline execution is done in Cloudplex

To execute Pipelines in a Cloudplex, you must set ALLOW_CLOUDPLEX_PROCESS_CREATION to true in the SnapLogicSecurityManager.java file. Contact SnapLogic Customer Support for help with the setting.


Examples

Reading from Adobe Experience Platform and Writing into SLDB and S3

 Reading from Adobe Experience Platform and Writing into separate instances

The pipeline below demonstrates the following operations:

  • Reading a data set from the Adobe Experience Platform
  • Filtering the data set
  • Writing the filtered data into SLDB and S3 (data matching one criteria to be written into the SLDB, while data matching another criteria to be written into S3)

The data set is a CSV file in the Adobe Experience Platform, it is a task list containing information such as Assignee, Reporter, Priority, and Resolution. This data is read using the Adobe Experience Platform Read Snap. The Snap is configured as shown below:

The output preview below shows the data set:

This data is filtered using Filter Snaps, the filtering criteria is the Priority - Highest, and Lowest. All tasks with priority Highest are written into the SLDB using the File Writer Snap and all tasks with priority Lowest are written into the S3 storage using the S3 File Writer Snap. The data is written into these Snaps in JSON format using the JSON Formatter Snaps. The File Writer and S3 File Writer Snaps are configured as shown below:

 


Exported pipeline is available in the Downloads section below.

Downloads

  File Modified

File AEP Read Example_1.slp

Jul 26, 2020 by Siddharth Menon


Snap Pack History

 Click to view/expand

4.24 (main8556)

  • No updates made.

4.23 423patches7447

  • Fixes the Adobe Experience Platform Execute Snap issue of not passing data correctly to the downstream Snap by creating Map obj = new LinkedHashMap(); inside loop. LinkedHashMap is a hash table and linked list implementation of the Map interface, with a predictable iteration order. 

4.23 (main7430)

  • Replaces the Adobe Cloud Platform Snap Pack.
  • Introduces the Adobe Experience Platform Read Snap that enables executing SQL queries in the Adobe Experience Platform.
  • Updates the Adobe Experience Platform JWT Account to enable you to create accounts in a Sandbox location during the development phase.
  • Enhances the Adobe Experience Platform Read Snap by adding fields, Batch IDsStart date, and End Date to allow filtering batches by ID, start date, and end date with millisecond precision.

4.22 (main6403)

4.21 Patches

4.21 (snapsmrc542)

4.20 (snapsmrc535)

  • No updates made.

4.19 (snapsmrc528)

  • No updates made.

4.18 (snapsmrc523)

  • Enhanced the Snap Pack to support the Map datatype in XSD-based datasets.

4.17 Patch ALL7402

  • Pushed automatic rebuild of the latest version of each Snap Pack to SnapLogic UAT and Elastic servers.

4.17 (snapsmrc515)

  • Added the Snap Execution field to all Standard-mode Snaps. In some Snaps, this field replaces the existing Execute during preview check box.

4.16 (snapsmrc508)

  • No updates made. Automatic rebuild with a platform release.

4.15 (snapsmrc500)

  • No updates made. Automatic rebuild with a platform release.

4.14 (snapsmrc490) 

  • No updates made. Automatic rebuild with a platform release.

4.13 (snapsmrc486)

  • New! Initial release of the Snap Pack. This includes Adobe Cloud Platform Read and Adobe Cloud Platform Write Snaps.
  • Introduced the basic Adobe Cloud Platform JWT Account.