- Created by Aparna Tayi (Unlicensed), last modified by Rakesh Chaudhary on Feb 07, 2019
You are viewing an old version of this page. View the current version.
Compare with Current View Page History
« Previous Version 17 Next »
Snap type: | Read | |||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Description: | This Snap polls the target directory and looks for file names matching the specified pattern. It continues polling at the intervals specified in the Polling interval property until the timeout (specified in the Polling timeout property) is reached. Once polling is done, the Snap lists all files whose names match the specified pattern. This Snap polls the target directory only; subdirectories, if any, are ignored. Use the Directory Browser Snap if you want to poll files in the directory and all subdirectories, as well as to poll a directory only once. The File Poller Snap can be used in situations where an operation must be triggered when a specific file is found in the target directory. The pipeline can be configured with additional Snaps to process the Snap's output and delete the matched file before the Polling interval value is reached.
[ { "path" : "sftp://sftp.smart.com/home/voo/test1.csv" }, { "path" : "sftp://sftp.smart.com/home/voo/test2.csv" } ] | |||||||||||||||||||||||||||||||||||||||||
Prerequisites: | IAM Roles for Amazon EC2 The 'IAM_CREDENTIAL_FOR_S3' feature is to access S3 files from EC2 Groundplex, without Access-key ID and Secret key in the AWS S3 account in the Snap. The IAM credential stored in the EC2 metadata is used to gain the access rights to the S3 buckets. To enable this feature, the following line should be added to global.properties and the jcc (node) restarted: Please note this feature is supported in the EC2-type Groundplex only. For more information on IAM Roles, see http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/iam-roles-for-amazon-ec2.html | |||||||||||||||||||||||||||||||||||||||||
Support and limitations: | Modes
Limitation
| |||||||||||||||||||||||||||||||||||||||||
Account: | This Snap uses account references created on the Accounts page of SnapLogic Manager to handle access to this endpoint. This Snap supports several account types, as listed in the table below, or no account. See Binary Account for information on setting up these types of accounts. Account types supported by each protocol are as follows:
Required settings for account types are as follows:
| |||||||||||||||||||||||||||||||||||||||||
Views: |
| |||||||||||||||||||||||||||||||||||||||||
Settings | ||||||||||||||||||||||||||||||||||||||||||
Label | Required. The name for the Snap. You can modify this to be more specific, especially if you have more than one of the same Snap in your pipeline. | |||||||||||||||||||||||||||||||||||||||||
Directory | This property is a URL path to the directory where files will be searched. The expected syntax is: The supported file protocols are:
Example:
Default value: [None]
| |||||||||||||||||||||||||||||||||||||||||
File filter | Required. A GLOB pattern to be applied to select one or more files in the directory. The File filter property can be a JavaScript expression which will be evaluated with values from the input view document.
Default value: [None] Glob Pattern Interpretation Rules Use glob patterns in this filter to select one or more files in the directory. For example:
The following rules are used to interpret glob patterns:
| |||||||||||||||||||||||||||||||||||||||||
Polling interval in seconds | Required. The time-gap between each poll request (in seconds). Example: 10 Default value: 30 | |||||||||||||||||||||||||||||||||||||||||
Polling timeout | Required. A period of time after which file polling must end. You specify the number here and the time unit in the next property. Its unit is selected in the next property. Example:
Default value: 30 Configure this property based on the expected number of files in the target directory. If there are many files and this property's value is small, the Snap may complete the operation and stop before the file is found. | |||||||||||||||||||||||||||||||||||||||||
Polling-timeout unit | Unit for the polling timeout. Allowed values are SECONDS, MINUTES and HOURS. Example: SECONDS Default value: MINUTES |
Examples
Writing out the List of Files in a Specific Directory Using the File Poller
In this example, you test the File Poller Snap to see whether it reliably lists out files from a specific directory. You then write the output to a file and run the File Poller Snap again to check whether the new file was created as expected. To ensure that the File Poller Snap doesn't pick up any existing files, you use an unusual extension for this exercise.
Download this pipeline.
File Poller
You add a File Poller Snap and configure it to poll a directory for all files with the extension ".JSON2":
You then use a combination of JSON Formatter and File Writer Snaps to process the output and write it out to a file. You use the date.now() function to give the file a name, so every time you run the pipeline, a new file is created.
You use the JSON Formatter Snap with the default settings.
File Writer
When used in production, the output from the File Poller Snap can be used to trigger specific tasks as needed. In this example, you write it to a file:
As expected, the file contains no output, as there is no file in the target directory with the extension ".JSON2".
You now add a second File Poller Snap and configure it exactly as you configured the first one. Once again, you add a JSON Formatter and File Writer Snap with the same settings as for the previous pair. But this time, the file created is not blank: It lists out the file that you created using the first three Snaps in the pipeline:
This tells you that the File Poller Snap works as expected with the settings you have used.
Download this pipeline.
Polling a Directory Using a Trigger Task from ServiceNow
In this example, you call a Trigger Task from ServiceNow to poll a directory for files of a specific type.
Download this pipeline
To make this example work, you must perform the following tasks:
- Create a pipeline that receives specifications from ServiceNow on the file type for which you want to poll a directory.
- Create a Trigger Task that will make the pipeline available as a REST API.
- Create a REST call in ServiceNow that will trigger the Task created in Step 2 above.
Creating the File Poller Pipeline
You design a pipeline containing the following Snaps:
- CSV Parser: Parses the data coming in from ServiceNow as a CSV document.
- Mapper: Makes the contents of the input CSV document available as a parameter.
- File Poller: Polls a specific directory for files matching the pattern specified in the parameter received from the Mapper Snap.
You will note that the File Poller has open input and output views. This is because it receives data from the Trigger Task associated with it and returns processed data back to the same Trigger Task.
CSV Parser
You use the CSV Parser Snap with the default settings:
Mapper
You configure the Mapper Snap to receive the parsed CSV data and map the message in the CSV document to the $msg variable:
File Poller
You configure the File Poller Snap to poll the /QA/Documentation/File Poller/ directory for all files that match the pattern contained in the $msg variable, which you use as a file filter parameter:
Creating a Trigger Task for the File Poller Pipeline
You save the pipeline, click the (Create Task) button, and configure the Trigger Task:
You click Update to complete setting up the task; then navigate to the Manager to view the Trigger Task's properties:
You copy the Cloud URL and authorization bearer token, and navigate to ServiceNow to set up the API call.
Creating a REST call in ServiceNow
Create a REST Call in ServiceNow by appending the authorization token to the Cloud URL that you copied in the previous step:
For details on how to set up REST calls using ServiceNow, see ServiceNow documentation.
While configuring the REST call, ensure that:
- HTTP Method is POST.
- Endpoint contains the Cloud URL concatenated with the bearer token.
- HTTP Parameters > Content contains the variable and extension value that you want to use.
You click Test to check the REST call. For a successful execution, the pipeline returns a list of files whose extension matches the value in the Content field:
Download this pipeline.
File | Modified |
---|
Release | Snap Pack Version | Date | Type | Updates |
---|---|---|---|---|
November 2024 | main29029 | Stable | Updated and certified against the current SnapLogic Platform release. | |
August 2024 | 438patches28197 | Latest |
| |
August 2024 | main27765 |
| Stable | Upgraded the |
May 2024 | 437patches27146 | Latest | Enhanced the Azure Storage Account with Managed Identity, which provides applications with an automatically managed identity for connecting to resources that support Microsoft Entra ID authentication. | |
May 2024 | 437patches26873 | Latest | Fixed an issue with the File Poller Snap where the Snap applied a case-sensitive filter in the Windows operating system. | |
May 2024 | 437patches26592 | Latest | Enhanced the Decompress Snap to support encrypted and unencrypted ZIP and 7z files through the new File Password Account type. | |
May 2024 | main26341 | Stable | The Azure Data Lake Account has been removed from the Binary Snap Pack because Microsoft retired the Azure Data Lake Storage Gen1 protocol on February 29, 2024. We recommend replacing your existing Azure Data Lake Account with other Azure Accounts. | |
February 2024 | 436patches25711 | Latest | Fixed an SMB (server message block) connectivity issue within the Binary Snap Pack, as the incorrect name provided by the SMB client did not match the Windows cluster virtual name, affecting the SPN (service principal name) connection. | |
February 2024 | 436patches25332 | Latest | Fixed a | |
February 2024 | 436patches25241 | Latest | Fixed an issue with the File Writer Snap, which partially writes the file for some FTPS servers by pausing for seconds before closing the output stream as specified in the global property | |
February 2024 | 436patches25161 | Latest | Fixed an issue with the File Poller Snap that displayed an exception when an unauthorized character ': ' was used in the Windows Snaplex. | |
February 2024 | main25112 | Stable | Updated and certified against the current SnapLogic Platform release. | |
November 2023 | 435patches24525 | Latest | Fixed an issue with the File Poller Snap that caused it to poll recursively for files in the root directory of the S3 bucket. | |
November 2023 | 435patches23780 | Latest | Fixed an issue with the Binary Snaps that failed to build a data connection when connecting to the FTP server over FTPS protocol. | |
November 2023 | main23721 | Stable | Updated and certified against the current SnapLogic Platform release. | |
August 2023 | 434patches23502 | Latest | Fixed an issue with the File Operation Snap (SFTP protocol) where the error message did not display during a move operation, although the existing file was available in the target path and the Error if exists checkbox was selected. | |
August 2023 | 434patches23302 | Latest | Fixed an issue that occurred when node properties were used to override default algorithm specifications for SFTP operations. | |
August 2023 | 434patches22976 | Latest | Fixed an issue that caused account credentials to be visible in the stack trace of some failed SFTP operations. | |
August 2023 | 434patches22842 | Latest | Fixed an issue that caused NTLM authentication issues when trying to access SMB servers. | |
August 2023 | 434patches22639 | Latest | The JSON key field in the Binary Google Service Account supports JSON strings. You can upload the JSON key either from SLDB or dynamically pass the value using a pipeline parameter or access values from Secrets Manager. | |
August 2023 | main22460 | | Stable | Updated and certified against the current SnapLogic Platform release. |
May 2023 | 433patches22297 | Latest |
| |
May 2023 | 433patches21913 | Latest |
| |
May 2023 | 433patches21870 | Latest | Added the PGP Sign Snap, which allows binary data to be signed using PGP. | |
May 2023 | 433patches21645 | Latest | With the 4.33 GA release, support for some algorithms for SFTP connection negotiation is removed for improved security and because we’ve updated the library used to connect to SFTP sources. With Snap Pack version | |
May 2023 | 433patches21576 | Latest | Fixed the issues with the AES Encrypt and AES Decrypt Snaps, where the Snaps previously did not include the error stack trace in the error view. The Snaps now provide detailed information in case of any issues or errors. | |
May 2023 | 433patches21482 | Latest |
Starting from version 433patches21482, the PGP Encrypt Snap will no longer support encryption with an expired key. To ensure continued support for encryption, we highly recommend extending the expiration of your PGP key. | |
May 2023 | 433patches21291 | Latest | Fixed an issue with the Multi File Reader Snap where it failed with the error S3 object not found when the Snap found no matching file to read and the Folder/File property value did not end with a forward slash (/) . | |
May 2023 | 433patches21179 | Latest |
| |
May 2023 | main21015 | Stable | The Key passphrase field in the Private Key Account now supports expressions, allowing dynamic evaluation using pipeline parameters when the expression button is enabled. | |
February 2023 | 432patches20458 | Latest | Fixed an issue where the ZipFile Read and ZipFIle Write Snaps failed to display the input schema for the File or File name field when using an expression. | |
February 2023 | 432patches20431 | Latest |
| |
February 2023 | 432patches20349 | Latest | The JSCH library has been upgraded to version 0.2.7. | |
February 2023 | main19844 | Stable | Upgraded with the latest SnapLogic Platform release. | |
November 2022 | 431patches18977 | Latest | The PGP Decrypt Snap now allows you to skip the signature verification when you face an issue with the signature in the encrypted file. | |
November 2022 | main18944 | Stable | Upgraded with the latest SnapLogic Platform release. | |
September 2022 | 430patches17933 | Latest |
| |
August Patch | 430patches17292 | Stable and Latest | Fixed an issue with the Directory Browser Snap, which failed with a null pointer exception error when connecting to the SFTP server containing a port number. The Binary Snap Pack is deployed as both the latest and stable distribution. We recommend that you use this version for your Org when using the recommended Snaplex version (main-13269 - 4.30 GA). | |
August 2022 | main17386 | Stable |
| |
4.29 Patch | 429patches16569 | Latest |
| |
4.29 Patch | 429patches15842 | Latest |
| |
4.29 | main15993 | Stable | Enhanced the following Snaps and Accounts that use SnapLogic File System (SLFS) to display Lint warnings in Pipelines when using incorrect file paths to read and write files. We recommend that you use the File Upload :Upload_icon: icon to specify the file path. | |
4.28 Patch | 428patches14919 | Latest |
| |
4.28 Patch | 428patches14736 | Latest | Fixed an issue in the File Writer, S3 File Writer, and ZipFile Write Snaps where the Snaps failed with | |
4.28 | main14627 | Stable |
| |
4.27 Patch | 427patches14283 | Latest |
| |
4.27 Patch | 427patches13004 | Latest | Fixed an issue with the SMB Account where the Snaps could not re-establish a lost connection to the SMB mount point. | |
4.27 | main12833 | Stable |
| |
4.26 Patch | 426patches12288 | Latest | Fixed a memory leak issue when using HDFS protocol in Binary Snaps. | |
4.26 Patch | 426patches11922 | Latest | Fixed an issue with the File Writer Snap, where the Snap failed to open a channel while accessing through a SFTP protocol. | |
4.26 Patch | 426patches11529 | Latest |
| |
4.26 | main11181 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.25 Patch | 425patches10994 | Latest |
| |
4.25 Patch | 425patches10217 | Latest |
| |
4.25 Patch | 425patches9581 | Latest | Fixed an issue with the PGP Decrypt Snap where the Snap writes an empty document to the output view when there is an error in the Snap. It will now decrypt the document and write it to the output view only if it succeeds. As of we have discovered an issue with this Binary patch affecting the PGP Decrypt Snap. In case your Pipelines use the PGP Decrypt Snap, we recommend you to NOT use this patch. Else, your Pipelines will likely fail. We're working on a fix and will be deploying a Snap patch soon. | |
4.25 Patch | 425patches9564 | Latest | Enhanced the SFTP session in Binary Snaps to support the SFTP servers which close SFTP sessions slowly. | |
4.25 | main9554 | Stable | Enhanced the S3 File Writer Snap with an ability to write S3objects with Access Control List (ACL) details in a single API call. In the 4.23 release, the S3 File Writer Snap used to write an S3 file and then set ACL if the ACL property was not empty. If the file write was successful and the ACL setting failed, both the output document in the output view and the error document in the error view was displayed. This issue has been resolved in the 4.24 release by enabling the Snap to configure ACL while writing the file. Therefore, the Snap produces an error document in the error view if the ACL configuration fails, irrespective of whether the file write action passes or fails. | |
4.24 Patch | 424patches9044 | - | Latest | Enhanced the S3 File Writer to use an MD5 checksum that automatically checks for data integrity and corruption while uploading the file. |
4.24 Patch | 424patches9020 | Latest | Fixed the file operation error of copying large S3 files in the File Operation Snap by supporting the transfer of zero-byte S3 files while uploading a file. | |
4.24 Patch | 424patches8876 | Latest |
| |
4.24 | main8556 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.23 Patch | 423patches8453 | Latest | Fixed an issue in the File Writer Snap with the ADL protocol, to perform the correct action when OVERWRITE is selected from the File Action drop-down field. | |
4.23 Patch | 423patches8368 | - | Latest | Fixed an encryption issue with the File Operation Snap by implementing both SSE-KMS and SSE-S3 supports to the Snap. |
4.23 Patch | 423patches8368 | - | Latest | Fixed an issue in the Snap Pack by removing the plaintext credentials in file URL from JCC log messages. |
4.23 Patch | 423patches8099 | - | Latest | Enhanced the Snap Pack by upgrading SMB client library. |
4.23 Patch | 423patches7958 | - | Latest | Fixed an issue with the File Writer Snap by avoiding overwriting of documents when using appending the data to a CSV file in SFTP. |
4.23 Patch | 423patches7958 | - | Latest | Rolled back the recent patch to Binary Snap Pack (File Writer Snap - 423patches7923) that might have induced SSL handshake failures/terminations in existing Pipelines. |
4.23 Patch | 423patches7923 | Latest |
Do not use the 423patches7923 build for the File Writer Snap, because it causes connectivity issues with the Snaplex nodes. | |
4.23 Patch | 423patches7795 | - | Latest | Fixed an issue with File Writer Snap by skipping the validation of the SAS URI having write permission, if the SAS URI uses an access policy. |
4.23 Patch | 423patches7660 | - | Latest | Enhanced the File Poller Snap by adding a field, Exit on first matches, which when set to true stops the Snap from executing after the first file paths matching the filter are written to the output view. If the field is not configured or is set to false (default value), then the Snap continues to poll the directory until the Polling timeout is reached. |
4.23 | main7430 | - | Stable | Enhanced the ZipFile Write Snap to provide the ability to change the default content-type (application/octet-stream) for any file that is stored into the Azure Blob Storage (WASB: or WASBS: file protocol). Hence, the files that the ZipFile Write Snap writes into the Blob Storage can be saved with content-type asapplication/zipor any other type instead of application/octet-streamalways. You can now prevent the Snap from writing files always to Azure Blob Storage (WASB: or WASBS: file protocol) with the application/octet-stream content-type. To do so, configure a binary header property in an upstream Snap, such as JSON Formatter or Mapper, to match the file's content – application/zip, application/java-archive and so on; and pass it as the $content-type (case-sensitive) for the file. |
4.22 Patch | 422patches6947 | - | Latest | Fixed the issue of the hanging thread in the SMB accounts. |
4.22 Patch | 422patches6950 | - | Latest | Enhanced the S3 Dynamic Account by allowing to use the Security token field in Directory Browser, File Operation, File Poller, Multi File Reader, and File Delete Snaps. |
4.22 Patch | 422patches6629 | - | Latest | Fixed the ZipFile Write Snap error by allowing the number of retries to be set greater than 0. |
4.22 Patch | 422patches6542 | - | Latest | Fixed SMB hanging threads by upgrading SMB client library. |
4.22 | main6403 | - | Latest |
|
4.21 Patch | 421patches6136 | - | Latest | Fixed the issue with Multi File Reader Snap that continues to look for a directory even when |
4.21 Patch | 421patches6090 | - | Latest | Fixed the 'Connection pool shut down' error in S3 File Writer Snap by keeping the AmazonS3Client class object open until all the documents are processed. |
4.21 Patch | 421patches6077 | - | Latest | Fixed the |
4.21 Patch | 421patches5994 | - | Latest | Fixed an error in Multi File Reader and File Delete Snaps during Pipeline execution where the Snaps fail to retrieve the temporary files from the given S3 location. |
4.21 Patch | 421patches5963 | - | Latest | Enhanced the Directory Browser Snap by making the File filter field optional. |
4.21 Patch | 421patches5975 | - | Latest | Fixed the Directory Browser Snap that fails with an |
4.21 Patch | 421patches5871 | - | Latest | When configuring the SSH Auth account type, SSH passphrase is now optional, whereas it was a required field earlier. |
4.21 Patch | binary8849 | - | Latest | Enhanced the Directory Browser Snap by adding a new advanced property Use fast file-type check for wasb/wasbs protocols for quick Snap execution. |
4.21 Patch | binary8843 | - | Latest | Fixed the issue in PGP Encrypt Snap where decrypting its output file using a third-party PGP software adds a random suffix and TMP extension in the file name. This issue occurs only when using the PGP Encrypt Snap in a Windows-based Groundplex. |
4.21 | snapsmrc542 | - | Stable | Upgraded with the latest SnapLogic Platform release. |
4.20 Patch | binary8801 | - | Latest |
|
4.20 Patch | binary8791 | - | Latest | Fixed the ZipFile Write Snap wherein the Snap fails to execute if it finds different zip file paths when processing multiple input binary data. |
4.20 Patch | binary8785 | - | Latest |
|
4.20 Patch | binary8775 | - | Latest | Fixed the File Writer Snap to allow the deletion of temporary Google Storage files from the |
4.20 Patch | binary8741 | - | Latest |
|
4.20 Patch | binary8710 | - | Latest |
|
4.20 | snapsmrc535 | - | Stable | Upgraded with the latest SnapLogic Platform release. |
4.19 Patch | binary8369 | - | Latest | Fixed the following issues associated with the SMB account wherein:
|
4.19 | snaprsmrc528 | - | Latest |
|
4.18 Patch | binary8768 | - | Latest |
|
4.18 Patch | binary8046 | - | Latest | Enhanced the Snap Pack to support AWS SDK 1.11.634 to fix the NullPointerException issue in the AWS SDK. This issue occurred in AWS-related Snaps that had HTTP or HTTPS proxy configured without a username and/or password. |
4.18 Patch | MULTIPLE7884 | - | Latest | Fixed an issue with the PostgreSQL grammar to better handle the single quote characters. |
4.18 Patch | binary7860 | - | Latest | Fixed an issue with the File Writer Snap wherein the Snap is intermittently unable to set correct permissions. |
4.18 Patch | binary7851 | - | Latest |
|
4.18 Patch | binary7746 | - | Latest | Fixed an issue with the SMB file protocol wherein Binary Snaps are unable to create a native thread using an SMB file path. |
4.18 Patch | MULTIPLE7778 | - | Latest | Updated the AWS SDK library version to default to the Signature Version 4 Signing process for API requests across all regions. |
4.18 Patch | binary7720 | - | Latest | Fixed an issue with the ZipFile Read Snap wherein the Snap fails to extract files from a zip file heavier than 100MB when the number of retries is greater than zero. |
4.18 | snapsmrc523 | - | Latest | Added a new account type, Google Service Account, which enables you to isolate workflows from individual users. |
4.18 | snapsmrc523 | - | Latest | Added a new account type, Google Service Account, which enables you to isolate workflows from individual users. |
4.17 Patch | binary7589 | - | Latest | Fixed an issue with the File Reader Snap wherein SMB fails to provide multiple Snaps with concurrent access. |
4.17 Patch | binary7487 | - | Latest | Fixed an issue with the File Writer Snap wherein the Overwrite File action for SMB files fails on subsequent executions. |
4.17 Patch | ALL7402 | - | Latest | Pushed automatic rebuild of the latest version of each Snap Pack to SnapLogic UAT and Elastic servers. |
4.17 Patch | binary7381 | - | Latest | Fixed an issue with SMB accounts wherein login to the server fails if password contains a plus (+) sign. |
4.17 Patch | binary7366 | - | Latest | Added support for multiple slashes as a prefix for SMB file URLs. |
4.17 Patch | binary7280 | - | Latest | Added a new field, File Delete Action, to the File Delete Snap that handles missing target files. |
4.17 Patch | snapsmrc515 | - | Latest |
|
4.16 Patch | binary7049 | - | Latest | Fixed an issue with the File Writer Snap wherein the Snap writes FTPS files partially. Two new global properties, ftpsDelayBeforeClosing and ftpDelayBeforeClosing, enable you to add delays to the FTP file protocol to handle the partial write. |
4.16 Patch | binary7049 | - | Latest | Fixed an issue with the File Writer Snap wherein the Snap writes FTPS files partially. Two new global properties, ftpsDelayBeforeClosing and ftpDelayBeforeClosing, enable you to add delays to the FTP file protocol to handle the partial write. |
4.16 Patch | binary6975 | - | Latest | Added a new property, Blob endpoint, for Binary Accounts, which enables you to specify the Azure Blob Storage endpoint that you want to use with an Azure Storage account. |
4.16 | snapsmrc508 | - | Latest | Added a new property Only Output on Change in the File Poller Snap. This property helps avoid redundancy by not displaying the same matching file in every polling result unless the file is changed. |
4.15 Patch | binary6744 | - | Latest | Fixed a timeout error while writing to S3 in the S3 File Writer Snap. |
4.15 Patch | binary6414 | - | Latest | Fixed an issue wherein the hostname specified in the Directory Browser path failed to appear as a path in the output document. |
4.15 Patch | binary6414 | - | Latest | Fixed an issue wherein the hostname specified in the Directory Browser path failed to appear as a path in the output document. |
4.15 | snapsmrc500 | - | Latest | Added a new property, Binary Header Properties, to the CSV Formatter Snap. This property can be configured with the binary headers and their values in the incoming document. |
4.14 Patch | MULTIPLE5732 | - | Latest | Fixed an issue with S3 file reads getting aborted intermittently because of incomplete consumption of input stream. |
4.14 | snapsmrc490 | - | Latest | Enhanced the Basic Auth and Symmetric Crypto accounts to support pipeline parameters. Using pipeline parameters, Basic Auth now supports passing username and password, and Symmetric Crypto now supports passing secret key dynamically. |
4.13 Patch | binary5372 | - | Latest | Updated the File Operation Snap for S3 to support files larger than 5GB by using an API for multipart upload copy. |
4.13 Patch | binary5315 | - | Latest | Added a new property "Enable staging" to enable the File Reader and S3 File Reader Snaps to perform as expected even in a slow network connection to AWS S3. |
4.13 | snapsmrc486 | - | Latest | Added AWS Key Management Service (KMS) encryption support to AWS S3 and S3 Dynamic accounts in the Binary Snap Pack. |
4.12 | binary5044 | - | Latest | Fixed an issue with the S3 File Writer Snap, which corrupts while writing files if retry value is set to 1. |
4.12 Patch | binary4882 | - | Latest | Fixed issue caused in the File Operation Snap due to the rollback after the 4.12 release that impacted the S3 and FTP protocols. |
4.12 Patch | binary4840 | - | Latest | Fixed an issue in the File Delete Snap, wherein if no account is given for the SFTP protocol, then the error did not display. |
4.12 Patch | binary4797 | - | Latest | Added a new property 'Number of retries' in the File Writer Snap to fix interoperability issues with a server software. |
4.12 Patch | binary4736 | - | Latest | Fixed the issue where File Writer Snap does not write files to Windows Serv-U FTP server, while not displaying any error message. |
4.12 | snapsmrc480 | - | Latest |
|
4.11 Patch | binary4424 | - | Latest | Resolved an Issue with SFTP server where the pipeline stopped responding while writing to the Tumbleweed server (SFTP server). Fixed the code in a way that the SFTP server now flushes out data after each write. |
4.11 Patch | binary4328 | - | Latest | Fixed an issue with the File Delete Snap that was unable to delete the file with a size greater than 1MB. |
4.11 Patch | snapsmrc465 | - | Latest |
|
4.11 | binary4019 | - | Stable | Resolved an issue with the File Writer Snap writing to an FTP Server that may prematurely close the connection; this patch ensures the write has fully completed before disconnecting. |
4.10 Patch | binary3930 | - | Latest | Directory Browser - When "Ignore empty result" is not selected, the "original" passthrough document is now returned even when the S3 directory is empty. |
4.10 Patch | binary3840 | - | Latest | S3OutputStream handles failures. |
4.10 | snapsmrc414 | - | Stable | No updates made. Automatic rebuild with a platform release. |
4.9 Patch | binary3331 | - | Latest | Directory Browser Snap - fixed NPE issue, "File filter" property, and "Display update time and owner for S3 subdirectories" property. |
4.9 Patch | binary3183 | - | Latest | Fixed SFTP connection leak when "Validate after write" is checked for File Write Snap. |
4.9 Patch | binary3170 | - | Latest | Addressed the following issue in Directory Browser: "Update time" being returned "unknown" for directories within S3 objects |
4.9 Patch | binary3081 | - | Latest | Added ability to sign PGP encrypted files. |
4.9 Patch | binary3060 | - | Latest | Addressed an issue in Directory Browser and fixed issue in writing the original document to output view when reading from S3. |
4.9 Patch | binary3022 | - | Latest | Addressed an issue regarding an array out of bounds exception when IAM Role is enabled. |
4.9 Patch | binary3000 | - | Latest |
|
4.9 | Snapsmrc405 | - | Stable | No updates made. Automatic rebuild with a platform release. |
4.8 Patch | Snapsmrc405 | - | Latest | Addressed an issue with Directory Browser taking too lont to start listing files from S3 bucket and then failing with partial results due to CPU spikes. |
4.8 | Snapsmrc398 | - | Latest |
|
4.7.0 Patch | binary2346 | - | Latest | ZipFile Read Snap: Added support for reading 7z archive formats created using Windows machines. |
4.7.0 Patch | binary2337 | - | Latest | Added Encrypted filename property to PGP Encrypt Snap. |
4.7 | Snapsmrc382 | - | Latest |
|
4.6.0 Patch | binary2110 | - | Latest | File Writer: fixed an issue on Windows Snaplexes that prevented creating directories that are not present. |
4.6.0 Patch | binary2009 | - | Latest | File Writer: fixed an issue on Windows Snaplexes that prevented creating directories that are not present. |
4.6.0 Patch | binary1898 | - | Latest | File Reader and ZipFile Reader Snaps: Added a new "Prevent URL encoding" setting to allow users to disable automatic URL encoding of file paths. This allows pre-encoded URLs and file paths to be used as-is. |
4.6.0 Patch | binary1851 | - | Latest | Resolved an issue with Directory Browser Snap not freeing up connections in Windows Groundplex. |
4.6.0 | Snapsmrc362 | Stable |
| |
4.5.1 | binary1563 | - | Latest |
|
4.5 | Snapsmrc344 | - | Stable |
|
4.4.1 | - | - | Latest |
|
4. | - | - | Stable |
|
4.3.2 | - | - | Latest |
|
4.3.1 | - | - | - |
|
4.3.0 | - | - | - |
|
4.2.2 | - | - | - |
|
4.2.1 | - | - |
| |
Summer 2015 | - | - | - |
|
- | - | - |
| |
- | - | - |
| |
- | - | - |
| |
- | - | - |
Multi File Reader: Resolved an issue were some files were read twice if Include subfolders was selected when using the S3 protocol. | |
- | - | - | Tooltip cleanup | |
- | - | November 2014 | - | File Writer now lets you set file permissions. |
- | - | July/Summer 2014 | - | NEW! ZipFile Read and Write |
- | - | April 2014 | - | File Writer Snap updated to allow for appending, overwriting, ignoring or erroring out if the file already exists. |
- | - | March 2014 | - |
|
- | - | January 2014 | - | An output view was added to File Writer. |
- | - | December 2013 | - |
|
- | - | November 2013 | - |
|
- | - | July 2013 | - | There are now separate Snaps for reading a single file into SnapLogic and reading multiple files (File Reader and Multi File Reader). |
- | - | June 2013 | - | Initial release. Read/write support for popular data formats: Binary, CSV, HTML, JSON |
- No labels