Bulk Extract

In this article

Overview

You can use this Snap to perform bulk extract (export) for the selected entity.

We recommend you use the UTC dates when leveraging the date-based fields to extract the correct number of records using the Bulk Extract Snap.

For more information, refer to the Marketo API documentation: Bulk Lead Extract - Marketo Developers.

 

Snap Type

The Marketo Bulk Extract Snap is a Read-type Snap that reads specific entities from Marketo.

Prerequisites

A valid account with the required permissions.

Support for Ultra Pipelines  

Works in Ultra Pipelines only when the Snap is in the non-lineage path.

Limitations

  • If you enable expressions for the Marketo Entity field, it's possible that other fields that are not relevant might be displayed in the UI (because of a UI limitation). If you think a field is not relevant, leave it blank.

  • The Marketo Bulk Extract Snap supports only one filter at a time for bulk export with Leads or Custom Objects as the Entity type. So, if you select multiple filters for these Entity types, Snap displays an error.

Known Issues

  • This Snap fails with a lineage error when used in the lineage path.

  • Marketo Snaps do not support some special characters (for example, (𝖖𝖗𝖘𝖬𝖭𝖮𝗕𝗖𝘧𝘨𝘩𝛀𝛁𝛂𝛃𝛄𝛅𝛆𝛇,𝖗𝖘𝖬𝛌𝛗𝛘𝛙𝛴).

Snap Views

Type

Format

Number of Views

Examples of Upstream and Downstream Snaps

Description

Type

Format

Number of Views

Examples of Upstream and Downstream Snaps

Description

Input 

Document

  • Min: 0

  • Max: 1

  • Mapper

Requires the Export format with filter data to retrieve the respective entity from Marketo.

Output

Document

  • Min: 0

  • Max: 2

  • Mapper

  • Union

  • Copy

  • Join

The extraced data relating to the specific entity.

Error

Error handling is a generic way to handle errors without losing data or failing the Snap execution. You can handle the errors that the Snap might encounter when running the Pipeline by choosing one of the following options from the When errors occur list under the Views tab:

  • Stop Pipeline Execution: Stops the current Pipeline execution if the Snap encounters an error.

  • Discard Error Data and Continue: Ignores the error, discards that record, and continues with the remaining records.

  • Route Error Data to Error View: Routes the error data to an error view without stopping the Snap execution.

Learn more about Error handling in Pipelines.

Snap Settings

  • Asterisk ( * ): Indicates a mandatory field.

  • Suggestion icon (): Indicates a list that is dynamically populated based on the configuration.

  • Expression icon ( ): Indicates the value is an expression (if enabled) or a static value (if disabled). Learn more about Using Expressions in SnapLogic.

  • Add icon ( ): Indicates that you can add fields in the field set.

  • Remove icon ( ): Indicates that you can remove fields from the field set.

  • Upload icon ( ): Indicates that you can upload files.

Field Name

Field Type

Field Dependency

Description

Field Name

Field Type

Field Dependency

Description

Label*

 

Default ValueMarketo Bulk Extract
ExampleMarketo_Bulk_Extract

String

N/A

Specify a unique name for the Snap.

 

Marketo Entity

 

Default ValueLeads
Example: Activities

String/Expression

N/A

Select one of the following entities for which you need to perform the bulk extract:

  • Leads - Marketo provides interfaces for the extraction of large sets of person data.

  • Activities - Extracts activities-related data.

  • Program Members -Extracts program members' data.

  • Custom Objects - Extracts custom object related data.

API Name*

Default Value: N/A
Example: clothing_c

String/Expression

Appears when you select Custom Objects for Marketo Entity.

Specify the Custom Object API name for which you must extract data.

Include export ID

Default ValueDeselected

Checkbox

None

Select this checkbox to display the export ID in the output.

Timeout (seconds)


Default Value0
Example: 1000

String/Expression

None

Specify the time in seconds to wait for the bulk extract to complete before it times out. A value of zero disables the timeout.

 

Number of Retries

 

Default Value0
Example: 3

String/Expression

None

Specify the number of attempts the Snap must make in case of connection failure or timeout.

Retry Interval (seconds)


Default Value1
Example: 4

String/Expression

None

Specify the minimum number of seconds the Snap must wait before each retry attempt.

Snap Execution

Default ValueValidate & Execute
Example: Execute only

Dropdown list

None

Select one of the following three modes in which the Snap executes:

  • Validate & Execute: Performs limited execution of the Snap, and generates a data preview during Pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during Pipeline runtime.

  • Execute only: Performs full execution of the Snap during Pipeline execution without generating preview data.

  • Disabled: Disables the Snap and all Snaps that are downstream from it.

Example

Extracting Data For Selective Fields For Program Members

This Pipeline demonstrates how to extract data for selected fields for Program Members - entity.

First, configure the Mapper Snap with the fields you want to extract for Program Members. You need to mention the start and the end date between which the records are updated for Program Members.

Configure the Marketo Bulk Extract Snap with Program Members for Marketo Entity for extracting the data for the specified fields for this entity.

On validation, Snap extracts data for the fields mapped. If a requested program member field is empty (contains no data), then a null value appears in the corresponding field in the output as below.

Download this Pipeline. 

  File Modified

File Example_Marketo_Bulk Extract.slp

Oct 17, 2022 by Lakshmi Manda

Downloads

  1. Download and import the Pipeline into SnapLogic.

  2. Configure Snap accounts, as applicable.

  3. Provide Pipeline parameters, as applicable.

Snap Pack History


Related Links