Input 

Document

• Min: 0

• Max: 1

• Mapper Snap

• Binary to Document Snap

• Sort Snap

Each input document contains details that can be used with the Schema Name, Dataset Name, or Connector Object Name fields to read data from Amazon S3 and write them into AEP.

Output

Document

• Min: 0

• Max: 1

• Mapper Snap

• Join Snap

• Union Snap

Each output document lists the status and other details associated with the AEP writing process.

Error

Error handling is a generic way to handle errors without losing data or failing the Snap execution. You can handle the errors that the Snap might encounter when running the Pipeline by choosing one of the following options from the When errors occur list under the Views tab:

• Stop Pipeline Execution: Stops the current Pipeline execution if the Snap encounters an error.

• Discard Error Data and Continue: Ignores the error, discards that record, and continues with the remaining records.

• Route Error Data to Error View: Routes the error data to an error view without stopping the Snap execution.

Learn more about Error handling in Pipelines.

Label*

Default Value: Adobe Experience Platform S3 Connector
Example: Write Documents from S3 to AEP

String

The name for the Snap. You can modify this to be more specific, especially if you have more than one of the same Snap in your Pipeline.

Schema

Default Value: N/A
Example: Snaplogic Demo Experience Event Schema

String/Expression

Specify the name of the schema to be used to create the data set to be written into AEP. This is a suggestible field.

Dataset Name*

Default Value: N/A
Example: Adobe Generic Dataset

String

Specify the name of the data set into which you want to write the Amazon S3 data. 

The Snap automatically creates a new data set if a data set with the specified name does not exist.

Connectors Object Name*

Default Value: s3://
Example: s3://testing-sl-bucket/xdm/File_Pipeline_3000000.parquet

String

Specify the URL of the Amazon S3 object that you want to read. This property is expression-enabled. For more information on the expression language, refer to Understanding Expressions in SnapLogic and Using Expressions. For information on Pipeline Parameters, refer to Pipeline Properties.

 Protocol required for this Snap: S3://.

Schema Type

Default Value: Parquet
Example: JSON

Dropdown list

Specify the schema type that you want to use to create the file that must be written. Click to select from the following options:

• Parquet

• JSON

The schema type of the source and destination files must be the same. 

Batch Monitor Tries*

Default Value: 360
Example: 300

Integer

Specify the number of times you want a batch to be monitored until it is completed.

Snap Execution

Default Value: Execute Only
Example: Validate & Execute

Dropdown list

Select one of the following three modes in which the Snap executes:

• Validate & Execute: Performs limited execution of the Snap, and generates a data preview during Pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during Pipeline runtime.

• Execute only: Performs full execution of the Snap during Pipeline execution without generating preview data.

• Disabled: Disables the Snap and all Snaps that are downstream from it.

Invalid Snap configuration

Property Schema Name is null or missing.

Provide a valid schema name.

Unable to load the private key for the given alias

File not found on <your SnapLogic instance> at <account location>.

This error appears when the account doesn't have valid values. Ensure that the Keystore path, Keystore passphrase, private key alias, and private key passphrase are correct. Also, you must upload the Keystore in the Keystore Path that you specify.

Unable to obtain an access token

This message appears when the endpoint account details are incorrect.

Check your Organization ID, Technical Account ID, Client ID, and Client Secret Key details and retry.