Files

In this article

Overview

SnapLogic Manager supports the upload and download of various types of files. As an asset type in Manager, Files are read by Pipelines, and likewise, Pipelines can write to these files. This functionality is known as sldb, and some Snaps, (for example, File Reader and File Writer) give it as an option in the context of development testing.

Do not use the Manager Files feature as a file system or storage. Use a Cloud storage provider to store production data. File Assets should not be used as a file source or as a destination in production pipelines. When you configure File Reader and Writer Snaps, set the file path to a cloud provider or external file system.

Supported use cases for reading from and writing to sldb:

  • JAR files

  • JDBC files

  • Expressions libraries (.expr)

  • Account-related configuration files

Pipelines can reference these types of files when processing data. Otherwise, do not use sldb to store data. Learn more about https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/1439404/Files#Limitations.

During Pipeline development, you can use Manager > Files to store static JAR files, expression library files, JDBC drivers, and parameter files for SnapLogic to use during Pipeline development. For example, you might upload .xls, .txt, .json or .csv files to design a Pipeline that executes on files stored in an S3 bucket during production.

The maximum file size is 100MB. You can upload them using Snaps that support file upload or in SnapLogic Manager, as described on this page. To reference an uploaded file in a Pipeline's field, use the following convention: sldb:///<YOUR_FILE_PATH>.

Limitations

  • File Assets are intended only for specialized files that a Pipeline uses to reference certain data, such as accounts, expressions, or JAR files. Because the platform does not restrict how files are used, admins should audit File uploads in their Orgs through the Activity Log.

  • File Assets have the following limitations:

    • The maximum file size is 100MB.

    • Projects should not contain more than 100,000 total Assets. File Assets count towards that total.

    • The following table lists files types that are not supported and describes why:

HTML-associated files can contain cookie-stealing JavaScript and web bugs:

PHP scripts might execute arbitrary code on the server:

Other types that might be interpreted by some servers:

Window executable files that can cause harm:

HTML-associated files can contain cookie-stealing JavaScript and web bugs:

PHP scripts might execute arbitrary code on the server:

Other types that might be interpreted by some servers:

Window executable files that can cause harm:

  • HTML

  • HTM

  • JSB

  • MHTML

  • MHT

  • XHTML

  • XHT

  • PHP

  • PHTML 

  • PHP3, PHP4, PHP5

  • PHPS

  • SHTML

  • JHTML

  • PL 

  • CGI

  • DMG

  • EXE

  • SCR

  • DLL

  • MSI

  • VBS

  • BAT

  • COM

  • PIF

  • CMD

  • VSD

  • CPL

  • VXD

  • APP

Adding Files to a Project

To upload files in Manager:

  1. From the Project Spaces tree, select the target project.

  2. In the Asset table toolbar, click to display the option menu:

  3. Select File.

  4. Click Choose Files open your system file navigator. S

  5. Select a file or hold SHIFT to select multiple files.

  6. Click Upload.

Deleting Files from a Project

Deleted files are not sent to the Recycle Bin, they are deleted permanently. To delete files in Manager:

  1. From the Project Spaces tree, select the project.

  2. Click the Files tab.

  3. Select the files to delete.

  4. In the Asset toolbar, click .

  5. Click Delete to confirm:

Viewing File Details 

On the Files tab within a project in Manager, you can see the file name, size, and when it was uploaded, by whom, and who updated it last. For files larger than 20 KB in size we recommend downloading the file instead of previewing it as described here.

To preview a file:

Hover over the file name for access to the context menu with the following options:

  • View the file. Displays a preview of the file data in either HEX or Text formats. 
    You can also download the file from this view.

     

  • Download. Downloads the file.

  • Activity Log. View information about the file.

Downloading Files from SnapLogic Manager

The files supported for upload are also supported for download. However, the following files types are only supported for downloading: HTML, PNG, and JPEG. 

To download files from Manager:

  1. In Manager, navigate to the target project.

  2. Click the Files tab.

  3. On the target file, click  to display the Asset dropdown list, then click Download. Alternately, double-clicking the file automatically downloads the file.

The file is downloaded to your target folder.