Migration from Binary Snaps to Amazon S3 Snaps

Overview

We plan to introduce additional S3 features exclusively in Amazon S3 Snaps, while Binary Snaps will not contain these updates. Therefore, we highly recommend you to use the Amazon S3 Snap Pack for all your S3 operations within your pipelines. However, Binary Snaps will be retained as is to maintain backward compatibility, but please be aware that we will no longer provide S3 support for the Binary Snaps.

Understanding the Migration from Binary Snaps to Amazon S3 Snaps

To execute S3 operations, use the Amazon S3 Snaps listed in the table below rather than Binary Snaps.

Binary Snaps (with S3 support)

Amazon S3 Snaps

Advantage

Binary Snaps (with S3 support)

Amazon S3 Snaps

Advantage

Directory Browser

S3 Browser

The Amazon S3 Browser Snap has higher performance than its equivalent.

File Reader 

S3 Download

The Amazon S3 Download Snap performs efficiently when handling numerous small S3 objects.

S3 File Reader

S3 Download

The Amazon S3 Download Snap demonstrates higher performance for numerous small S3 objects.

File Writer

S3 Upload

The S3 Upload Snap demonstrates higher performance, when handling numerous small S3 objects.

S3 File Writer

S3 Upload

The S3 Upload Snap demonstrates higher performance for many small S3 objects than the S3 File Writer Snap.

File Delete

S3 Delete

The S3 Delete Snap has higher performance compared to the File Delete Snap.

File Operation

S3 Copy and S3 Delete

The S3 Copy and S3 Delete Snaps are equivalent to the File Operation (Move) Snap.

The AWS S3 API does not have a move command. The File Operation Snap performs copy and delete for move operation for protocols that do not have a move command.

Multi File Reader

S3 Browser + S3 Download

The S3 Browser and S3 Download Snaps replace the Multi File Reader Snap.

File Poller

Planned

We plan to develop the S3 Poller Snap in the Amazon S3 Snap Pack.

ZIpFile Read

N/A

We plan to add PK Zip and 7-Zip support to the Decompress Snap.

ZipFile Write

N/A

We plan to add PKZip and 7-Zip support to the Compress Snap.

N/A

S3 Select

There is no corresponding equivalent Snap for these Snaps in the Binary Snap Pack.

N/A

S3 Archive

N/A

S3 Restore

N/A

S3 Presigned