Adobe Experience Platform S3 Connector (PS Snap)
In this article
Overview
You can use the Adobe Experience Platform S3 Connector Snap to read files from Amazon S3 and write them as JSON or Parquet files into Adobe Experience Platform (AEP). The Amazon file you want to read should have the same structure as the schema specified in the Schema Name field. If you do not have a file configured appropriately, use the File Generator Snap to generate the file and then reference it here.
Prerequisites
The schema you want to use with this Snap should exist in the Adobe Experience Platform. If you do not have the schema ready, create it using the Adobe Experience Platform user interface before using this Snap.
Limitations and Known Issues
None.
Snap Views
Type | Format | Number of Views | Examples of Upstream and Downstream Snaps | Description |
---|---|---|---|---|
Input | Document |
|
| Each input document contains details that can be used with the Schema Name, Dataset Name, or Connector Object Name fields to read data from Amazon S3 and write them into AEP. |
Output | Document |
|
| Each output document lists the status and other details associated with the AEP writing process. |
Error | Error handling is a generic way to handle errors without losing data or failing the Snap execution. You can handle the errors that the Snap might encounter when running the Pipeline by choosing one of the following options from the When errors occur list under the Views tab:
Learn more about Error handling in Pipelines. |
Snap Settings
Asterisk ( * ): Indicates a mandatory field.
Suggestion icon (): Indicates a list that is dynamically populated based on the configuration.
Expression icon ( ): Indicates the value is an expression (if enabled) or a static value (if disabled). Learn more about Using Expressions in SnapLogic.
Add icon ( ): Indicates that you can add fields in the fieldset.
Remove icon ( ): Indicates that you can remove fields from the fieldset.
The upload icon ( ): Indicates that you can upload files.
Field Name | Field Type | Description |
---|---|---|
Label*
Default Value: Adobe Experience Platform S3 Connector | String | The name for the Snap. You can modify this to be more specific, especially if you have more than one of the same Snap in your Pipeline.
|
Schema
Default Value: N/A | String/Expression | Specify the name of the schema to be used to create the data set to be written into AEP. This is a suggestible field. |
Dataset Name*
Default Value: N/A | String | Specify the name of the data set into which you want to write the Amazon S3 data. The Snap automatically creates a new data set if a data set with the specified name does not exist. |
Connectors Object Name*
Default Value: s3:// | String | Specify the URL of the Amazon S3 object that you want to read. This property is expression-enabled. For more information on the expression language, refer to Understanding Expressions in SnapLogic and Using Expressions. For information on Pipeline Parameters, refer to Pipeline Properties. Protocol required for this Snap: S3://. |
Schema Type
Default Value: Parquet | Dropdown list | Specify the schema type that you want to use to create the file that must be written. Click to select from the following options:
The schema type of the source and destination files must be the same. |
Batch Monitor Tries*
Default Value: 360 | Integer | Specify the number of times you want a batch to be monitored until it is completed. |
Snap Execution Default Value: Execute Only | Dropdown list | Select one of the following three modes in which the Snap executes:
|
Troubleshooting
Error | Reason | Resolution |
---|---|---|
Invalid Snap configuration | Property Schema Name is null or missing. | Provide a valid schema name. |
Unable to load the private key for the given alias | File not found on <your SnapLogic instance> at <account location>. | This error appears when the account doesn't have valid values. Ensure that the Keystore path, Keystore passphrase, private key alias, and private key passphrase are correct. Also, you must upload the Keystore in the Keystore Path that you specify. |
Unable to obtain an access token | This message appears when the endpoint account details are incorrect. | Check your Organization ID, Technical Account ID, Client ID, and Client Secret Key details and retry.
|
Snap Pack History
Have feedback? Email documentation@snaplogic.com | Ask a question in the SnapLogic Community
© 2017-2024 SnapLogic, Inc.