Input 

Document

• Min:0

• Max:1

N/A

N/A

Output

Binary

• Min:1

• Max:1

• File Writer

• CSV Parser

• JSON Parser

• XML Parser

Binary data read from the source specified in the Selected files property.

Error

Error handling is a generic way to handle errors without losing data or failing the Snap execution. You can handle the errors that the Snap might encounter while running the Pipeline by choosing one of the following options from the When errors occur list under the Views tab. The available options are:

• Stop Pipeline Execution: Stops the current pipeline execution when the Snap encounters an error.

• Discard Error Data and Continue: Ignores the error, discards that record, and continues with the rest of the records.

• Route Error Data to Error View: Routes the error data to an error view without stopping the Snap execution.

Learn more about Error handling in Pipelines.

sldb

no account

s3

AWS S3

ftp

Basic Auth

sftp

Basic Auth, SSH Auth

ftps

Basic Auth

hdfs

no account

http

no account

https

no account

smb

SMB

wasb

Azure Storage

wasbs

Azure Storage

gs

Google Storage

Basic Auth

Username, Password

AWS S3

Access-key ID, Secret key

SSH Auth

Username, Private key, Key Passphrase

SMB

Domain, Username, Password

Azure Storage

Account name, Primary access key

Google Storage

Approval prompt, Application scope, Auto-refresh token
(Read-only properties are Access token, Refresh token, Access token expiration, OAuth2 Endpoint, OAuth2 token and Access type.)

Label*

Default Value: Multi File Reader
Example: Multi File Reader

String

Specify the name for the Snap. You can modify this to be more specific, especially if you have more than one of the same Snap in your Pipeline.

Selected Files 

Use this field set to define data sources. 

Folder/File

Default Value: [None]

Example: 

• s3:///<S3_bucket_name>@s3.<region_name>.amazonaws.com/<path>
  For region names and their details, see AWS Regions and Endpoints.

• sftp://ftp.snaplogic.com:22/dir/filename

• smb://smb.Snaplogic.com:445/test_files/csv/input.csv

String/Expression

Specify the URL for the data source, which can be a directory or a file. It should begin with a file protocol. The supported file protocols are:

• http:

• https:

• s3:

• sftp:

• ftp:

• ftps:

• hdfs:

• sldb:

• smb:

• wasb:

• wasbs:

• gs:

The File property should have the syntax: [protocol]://[host][:port]/[path]

• _filename (A key/value pair with "filename" key should be defined as a pipeline parameter.)

• If a Pipeline is created in a project other than the shared project and you want to read the "asset.json" file from the shared project, enter "shared/asset.json" or "sldb:///shared/asset.json".

• If a Pipeline is created in the shared project and you want to read the "asset.json" file from the shared project, enter "asset.json" or "sldb:///asset.json".

In the WASB and WASBS file URL, the top directory should be the name of the 'Azure Storage container'.

• If an account is not used within the Snap, then use: s3://yourAcccessKeyID:yourSecretKey@s3/yourBucketName/folder1/folder2/ 

• if an account is not used within the Snap, then use:
  s3://yourAcccessKeyID:yourSecretKey@s3/yourBucketName/folder1/rawData.csv

• If the Snap is executed in the Windows Groundplex and needs to access D: drive, then use file:///D:/testFolder/ 

• To read files in the 'testDir' folder in the 'Snaplogic' container, then use wasb:///Snaplogic/testDir/sample.csv  

• If the bucket name is 'testBucket', then gs:///testBucket/testDir/ 

Wildcard 

Default Value: [None]
Example: 

• *.*

• *.csv

• *.json

• *.??? (matches all files with three-character extensions)

String/Expression

Specify the wildcard pattern, if the URL in the Folder/File property is for a directory. All files matching the wildcard pattern are selected. This property is not supported for the sldb, http, and https protocols. The asterisk pattern character ("*", also called "star") and the question mark ("?") are supported. The "*" character matches zero or more characters. The "?" matches exactly one character.

Include Subfolders 

Default Value: Not selected 

Checkbox

Select to search subfolders for the specified Wildcard if Folder/File is set to a directory.

If you select this checkbox and the Folder/File property is a folder, all files in the subfolders matching the given wildcard pattern are selected. This checkbox is not supported for the sldb, http, and https protocols.

Number of retries

Default Value: 0
Example: 3

Integer/Expression

Specify the maximum number of retry attempts the Snap must make in case there is a network failure, and the Snap is unable to read the target file.

If the value is larger than 0, the Snap first downloads the target file to a temporary local file. If any error occurs during the download, the Snap waits for the time specified in the Retry interval and attempts to download the file again from the beginning. When the download is successful, the Snap starts to stream the data from the temporary file to the downstream pipeline. All temporary local files are deleted when they are no longer needed.

Minimum value: 0

Retry interval (seconds)

Default value: 1
Example: 3

Integer/Expression

Specify the minimum number of seconds for which the Snap must wait before attempting recovery from a network failure.

Minimum value: 1

Advanced Properties

Use this field set to define additional properties.

SAS URI

Dropdown list

Values

String/Expression

Specify the value for the property.

Snap Execution

Dropdown list

Select one of the three modes in which the Snap executes. Available options are:

• Validate & Execute: Performs limited execution of the Snap, and generates a data preview during Pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during Pipeline runtime.

• Execute only: Performs full execution of the Snap during Pipeline execution without generating preview data.

• Disabled: Disables the Snap and all Snaps that are downstream from it.

S3

• content-type

• content-length

• last-modified: _snaptype_datetime

• etag

• accept-ranges

• content-location

• content-disposition

SLDB

• content-type

• date

• x-amz-meta-md5

• content-length

• server

• x-amz-server-side-encryption

• x-amz-meta-length

• x-amz-meta-create_time

• last-modified: _snaptype_datetime

• x-amz-meta-file_id

• x-amz-meta-ttl

• content-disposition

• x-amz-meta-owner

• x-amz-meta-expire_time

• etag

• x-amz-request-id

• x-amz-meta-mimetype

• x-amz-id-2

• accept-ranges

• content-location

• WASB

• SMB

• SFTP

• GStorage

• content-type

• content-location

• content-disposition