Workday Prism Analytics Bulk Load

On this Page

Overview

Use the Workday Prism Analytics Bulk Load Snap to upload multiple records/files from many cloud or on-premise sources (such as ERP, CRM, and other databases) to derive analytical reports on the input data. SnapLogic integrates Workday Prism Analytics's Utilize Data Load API, enabling you to use the Workday Prism Analytics Bulk Load Snap in conjunction with other standard-mode Snaps. This Snap comes with OAuth 2.0 authentication to secure your data. 

This Snap accepts documents from the input view, creates a batch CSV file, and also compresses and uploads the same to an existing or new dataset or table. 

Modes

Expected Input and Output

  • Input: 
    • First input: A document with data that can comprise numbers, text, Boolean, and date/time stamps.
    • Second input: A schema definition. Ensure that you pass name and type data types in the schema definition.
  • Output: A document that states the number of records processed and can contain the ID, name, bucket size, state, and processed files.

The following are a few SnapLogic Snap Packs that can work with the Workday Prism Analytics Bulk Load Snap:

  • Binary 
  • Transform 
  • REST
  • Microsoft Dynamics AX/CRM 
  • MS Dynamics 365 for Sales
  • Salesforce

Configuring Views

Input view

One or two documents
Output viewOne document
Error viewOne document

Limitations and Known Issues

  • Max bucket size: 3GB (compressed)
  • Maximum size of a single file is 256MB (compressed; handled internally by Workday Prism Analytics Snap)
  • Max size of all files across buckets: 100GB (compressed)
  • Max files per bucket: 100
  • Max concurrent file uploads: 10
  • Max buckets: 100 (in a rolling 24 hour period)
  • File names are not modifiable but are replaceable
  • JCC logs do not contain Retry messages in case of network failures 
  • The Snap does not support Delta Lake operations currently.

  • The Snap does not support using Workday Instance ID for creating data set/tables.

Snap Settings


Parameter NameData TypeDescriptionDefault ValueExample Value
LabelStringEnter a name for the Snap. This needs to be unique within the Pipeline.Workday Prism Analytics Bulk LoadBulk Load Updated Data
Dataset/Table NameString

The name of the dataset or table to which you want to upload the input documents. The dataset or table name must match with the dataset name in Workday Prism Analytics. This field can accept up to 255 alphanumeric and underscore characters. The string must start with a letter and cannot end with an underscore.

  • Ensure that the user has at least Write permission for the target endpoint in Workday Prism Analytics.
  • The table or dataset names used must be unique.
  • While creating a table, you must offer the table’s schema as an input to the Snap.
N/AAnalytics dataset
Create Dataset/Table if Not PresentCheck boxSelect this check box to create an empty dataset or table if there is no corresponding dataset or table in Workday Prism Analytics. DeselectedNA
Operation TypeObject

Specify whether you want to add or replace data in the existing dataset/table. Available options are:

  • Append: Adds data to the existing dataset/table.

    The schema of the incoming data must match the schema of the existing data in the dataset/table. Schema validation fails in case of a mismatch in column IDcolumn name, and column type; but does not fail if the metadata fields, such as defaultValueand description, do not match the target dataset schema. The Snap replaces mismatched metadata fields.

  • Replace: Replaces the data in the existing endpoint with the input data. 
AppendNA
Bucket Completion TimeoutInteger

A Workday bucket is a folder that contains all the files that you want to upload to Workday at a time. Once the Snap is able to connect to your Workday Prism Analytics account, it creates a bucket using the data that you provide to the Snap.


The maximum number of minutes for which you want the Snap to wait for the bucket to complete the bulk upload. We recommend that you update this value depending on the size of the data that you want to upload. If the bulk load is not completed within the completion timeout period, the operation times out.

Default value: 30

Minimum value: 1

Maximum value: 9999999999999990

3010
Connection TimeoutInteger

The number of seconds after which the Snap must abort while executing. 

Minimum value: 0

Maximum value: 999999999

30 30
Maximum Retry AttemptsInteger

The maximum number of retry attempts that this Snap must make to connect with Workday Prism Analytics, after which the Pipeline will abort. 

Minimum value: 1

Maximum value: 9999999999999990

55
Retry Request IntervalInteger

The number of seconds for which the Snap must wait between two retry requests.

Minimum value: 0

Maximum value: 9999999999999990

33
Snap execution Check box

Select one of the three modes in which the Snap executes. Available options are:

  • Validate & Execute: Performs limited execution of the Snap, and generates a data preview during Pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during Pipeline runtime.
  • Execute only: Performs full execution of the Snap during Pipeline execution without generating preview data.
  • Disabled: Disables the Snap and all Snaps that are downstream from it.

DeselectedN/A

Temporary Files

During execution, data processing on Snaplex nodes occurs principally in-memory as streaming and is unencrypted. When larger datasets are processed that exceeds the available compute memory, the Snap writes Pipeline data to local storage as unencrypted to optimize the performance. These temporary files are deleted when the Snap/Pipeline execution completes. You can configure the temporary data's location in the Global properties table of the Snaplex's node properties, which can also help avoid Pipeline errors due to the unavailability of space. For more information, see Temporary Folder in Configuration Options

Example

This use case demonstrates a Pipeline that derives how many opportunities in Microsoft Dynamics CRM converted into revenue in the preceding 3, 6, and 12 months. This data is derived by integrating Dynamics CRM/AX with Workday Prism Analytics using a host of SnapLogic Snaps. You can download the following pipeline and configure the respective accounts and data files to explore this use case. 

Pipeline Example

Preview Outputs

Pipeline 1

Pipeline 2

Downloads

Snap Pack History

 Click to view/expand
Release Snap Pack VersionDateType  Updates
August 2024main27765 StableUpgraded the org.json.json library from v20090211 to v20240303, which is fully backward compatible.

May 2024

main26341

 

Stable

Updated and certified against the current SnapLogic Platform release.

February 2024main25112 StableUpdated and certified against the current SnapLogic Platform release.
November 2023main23721 StableUpdated and certified against the current SnapLogic Platform release.

August 2023

main22460

 

Stable

Updated and certified against the current SnapLogic Platform release.

May 2023

main21015 

Stable

Upgraded with the latest SnapLogic Platform release.

February 2023main19844 StableUpgraded with the latest SnapLogic Platform release.
November 2022main18944 StableUpgraded with the latest SnapLogic Platform release.
August 2022main17386 StableUpgraded with the latest SnapLogic Platform release.
4.29main15993 StableUpgraded with the latest SnapLogic Platform release.
4.28main14627 StableUpgraded with the latest SnapLogic Platform release.
4.27main12833 StableUpgraded with the latest SnapLogic Platform release.
4.26main11181 StableUpgraded with the latest SnapLogic Platform release.
4.25 Patch425patches10994 Latest

Enhanced the Workday Prism Analytics Bulk Load Snap to support HTTP Proxy Authentication.

4.25main9554
 
StableUpgraded with the latest SnapLogic Platform release.
4.24main8556
StableUpgraded with the latest SnapLogic Platform release.
4.23main7430
 
StableUpgraded with the latest SnapLogic Platform release.
4.22main6403
 
StableUpgraded with the latest SnapLogic Platform release.
4.21snapsmrc542

 

StableUpgraded with the latest SnapLogic Platform release.
4.20snapsmrc535
 
Stable
4.19snaprsmrc528
 
StableUpgraded with the latest SnapLogic Platform release.
4.18snapsmrc523
 
StableUpgraded with the latest SnapLogic Platform release.
4.17ALL7402
 
Latest

Pushed automatic rebuild of the latest version of each Snap Pack to SnapLogic UAT and Elastic servers.

4.17snapsmrc515
 
Latest

Added the Snap Execution field to all Standard-mode Snaps. In some Snaps, this field replaces the existing Execute during preview check box.

4.16 Patch workdayprism6801 Latest

Added a new property, Append, to the Bulk Load Snap that lets you add data to an existing dataset. 

4.16snapsmrc508
 
Stable

Updated the name of Workday Prism Snap Pack to Workday Prism Analytics Snap Pack.

4.15snapsmrc500
 
StableUpgraded with the latest SnapLogic Platform release.
4.14snapsmrc490
 
Stable

New Snap Pack: Introducing Workday Prism Snap Pack with the Bulk Load Snap.