/
Bulk Extract

Bulk Extract

In this article

Overview

You can use this Snap to perform bulk extract (export) for the selected entity.

We recommend you use the UTC dates when leveraging the date-based fields to extract the correct number of records using the Bulk Extract Snap.

For more information, refer to the Marketo API documentation: Bulk Lead Extract - Marketo Developers.

marketo-bulk-extract-snap.png

 

Snap Type

The Marketo Bulk Extract Snap is a Read-type Snap that reads specific entities from Marketo.

Supported Accounts

Prerequisites

A valid account with the required permissions.

Limitations

  • Works in Ultra Pipelines only when the Snap is in the non-lineage path.

  • If you enable expressions for the Marketo Entity field, it's possible that other fields that are not relevant might be displayed in the UI (because of a UI limitation). If you think a field is not relevant, leave it blank.

  • The Marketo Bulk Extract Snap supports only one filter at a time for bulk export with Leads or Custom Objects as the Entity type. So, if you select multiple filters for these Entity types, Snap displays an error.

Known Issues

  • This Snap fails with a lineage error when used in the lineage path.

  • Marketo Snaps do not support some special characters (for example, (𝖖𝖗𝖘𝖬𝖭𝖮𝗕𝗖𝘧𝘨𝘩𝛀𝛁𝛂𝛃𝛄𝛅𝛆𝛇,𝖗𝖘𝖬𝛌𝛗𝛘𝛙𝛴).

Snap Views

Type

Format

Number of Views

Examples of Upstream and Downstream Snaps

Description

Type

Format

Number of Views

Examples of Upstream and Downstream Snaps

Description

Input 

Document

  • Min: 0

  • Max: 1

  • Mapper

Requires the Export format with filter data to retrieve the respective entity from Marketo.

Output

Document

  • Min: 0

  • Max: 2

  • Mapper

  • Union

  • Copy

  • Join

The extraced data relating to the specific entity.

Error

Error handling is a generic way to handle errors without losing data or failing the Snap execution. You can handle the errors that the Snap might encounter when running the Pipeline by choosing one of the following options from the When errors occur list under the Views tab:

  • Stop Pipeline Execution: Stops the current Pipeline execution if the Snap encounters an error.

  • Discard Error Data and Continue: Ignores the error, discards that record, and continues with the remaining records.

  • Route Error Data to Error View: Routes the error data to an error view without stopping the Snap execution.

Learn more about Error handling in Pipelines.

Snap Settings

  • Asterisk ( * ): Indicates a mandatory field.

  • Suggestion icon (): Indicates a list that is dynamically populated based on the configuration.

  • Expression icon ( ): Indicates the value is an expression (if enabled) or a static value (if disabled). Learn more about Using Expressions in SnapLogic.

  • Add icon ( ): Indicates that you can add fields in the field set.

  • Remove icon ( ): Indicates that you can remove fields from the field set.

  • Upload icon ( ): Indicates that you can upload files.

Field Name

Description

Field Name

Description

Label*

String

 

 

Specify a unique name for the Snap.

Default Value: Marketo Bulk Extract
Example: Marketo_Bulk_Extract

Marketo Entity

String/Expression

 

 

Select one of the following entities for which you need to perform the bulk extract:

  • Leads - Marketo provides interfaces for the extraction of large sets of person data.

  • Activities - Extracts activities-related data.

  • Program Members -Extracts program members' data.

  • Custom Objects - Extracts custom object related data.


Default Value: Leads
Example: Activities

API Name*

String/Expression

 

Appears when you select Custom Objects for Marketo Entity.

Specify the Custom Object API name for which you must extract data.

 

Default Value: N/A
Example: clothing_c

Include export ID

Checkbox

Select this checkbox to display the export ID in the output.


Default Value: Deselected

Include record count

Checkbox

 

When you select this checkbox, the number of records processed by the export job is included in the output document. ThenumberOfRecords field is read from the response, and its value is added to the output data under the key numberOfRecords. Each output document includes a copy of the numberOfRecords field with the processed record count reported by the Marketo export job.

Default Value: Deselected

Timeout (seconds)

String/Expression



Specify the time in seconds to wait for the bulk extract to complete before it times out. A value of zero disables the timeout.

Default Value: 0
Example: 1000

Number of Retries

String/Expression

 

 

Specify the number of attempts the Snap must make in case of connection failure or timeout.

 

Default Value: 0
Example: 3

Retry Interval (seconds)

String/Expression



Specify the minimum number of seconds the Snap must wait before each retry attempt.

 

Default Value: 1
Example: 4

Snap Execution

Dropdown list

 

 

Select one of the following three modes in which the Snap executes:

  • Validate & Execute: Performs limited execution of the Snap, and generates a data preview during Pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during Pipeline runtime.

  • Execute only: Performs full execution of the Snap during Pipeline execution without generating preview data.

  • Disabled: Disables the Snap and all Snaps that are downstream from it.

 

Default Value: Validate & Execute
Example: Execute only

Example

Extracting Data For Selective Fields For Program Members

This Pipeline demonstrates how to extract data for selected fields for Program Members - entity.

First, configure the Mapper Snap with the fields you want to extract for Program Members. You need to specify the start and end dates during which the records for Program Members are updated.

Configure the Marketo Bulk Extract Snap with Program Members for the Marketo Entity to extract data for the specified fields.

Upon validation, Snap extracts data for the fields mapped. If a requested program member field is empty (contains no data), then a null value appears in the corresponding field in the output as below.

Download this Pipeline. 

Downloads

  1. Download and import the Pipeline into SnapLogic.

  2. Configure Snap accounts, as applicable.

  3. Provide Pipeline parameters, as applicable.

Snap Pack History

Related Links