Skip to end of banner
Go to start of banner

Bulk Extract

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 37 Current »

In this article

Overview

You can use this Snap to perform bulk extract (export) for the selected entity.

We recommend you use the UTC dates when leveraging the date-based fields to extract the correct number of records using the Bulk Extract Snap.

For more information, refer to the Marketo API documentation: Bulk Lead Extract - Marketo Developers.

Snap Type

The Marketo Bulk Extract Snap is a Read-type Snap that reads specific entities from Marketo.

Prerequisites

A valid account with the required permissions.

Support for Ultra Pipelines  

Works in Ultra Pipelines only when the Snap is in the non-lineage path.

Limitations

  • If you enable expressions for the Marketo Entity field, it's possible that other fields that are not relevant might be displayed in the UI (because of a UI limitation). If you think a field is not relevant, leave it blank.

  • The Marketo Bulk Extract Snap supports only one filter at a time for bulk export with Leads or Custom Objects as the Entity type. So, if you select multiple filters for these Entity types, Snap displays an error.

Known Issues

  • This Snap fails with a lineage error when used in the lineage path.

  • Marketo Snaps do not support some special characters (for example, (𝖖𝖗𝖘𝖬𝖭𝖮𝗕𝗖𝘧𝘨𝘩𝛀𝛁𝛂𝛃𝛄𝛅𝛆𝛇,𝖗𝖘𝖬𝛌𝛗𝛘𝛙𝛴).

Snap Views

Type

Format

Number of Views

Examples of Upstream and Downstream Snaps

Description

Input 

Document

  • Min: 0

  • Max: 1

  • Mapper

Requires the Export format with filter data to retrieve the respective entity from Marketo.

Output

Document

  • Min: 0

  • Max: 2

  • Mapper

  • Union

  • Copy

  • Join

The extraced data relating to the specific entity.

Error

Error handling is a generic way to handle errors without losing data or failing the Snap execution. You can handle the errors that the Snap might encounter when running the Pipeline by choosing one of the following options from the When errors occur list under the Views tab:

  • Stop Pipeline Execution: Stops the current Pipeline execution if the Snap encounters an error.

  • Discard Error Data and Continue: Ignores the error, discards that record, and continues with the remaining records.

  • Route Error Data to Error View: Routes the error data to an error view without stopping the Snap execution.

Learn more about Error handling in Pipelines.

Snap Settings

  • Asterisk ( * ): Indicates a mandatory field.

  • Suggestion icon ((blue star)): Indicates a list that is dynamically populated based on the configuration.

  • Expression icon ((blue star) ): Indicates the value is an expression (if enabled) or a static value (if disabled). Learn more about Using Expressions in SnapLogic.

  • Add icon ( (blue star) ): Indicates that you can add fields in the field set.

  • Remove icon ( (blue star)): Indicates that you can remove fields from the field set.

  • Upload icon ((blue star) ): Indicates that you can upload files.

Field Name

Field Type

Field Dependency

Description

Label*

Default ValueMarketo Bulk Extract
ExampleMarketo_Bulk_Extract

String

N/A

Specify a unique name for the Snap.

Marketo Entity

Default ValueLeads
Example: Activities

String/Expression

N/A

Select one of the following entities for which you need to perform the bulk extract:

  • Leads - Marketo provides interfaces for the extraction of large sets of person data.

  • Activities - Extracts activities-related data.

  • Program Members -Extracts program members' data.

  • Custom Objects - Extracts custom object related data.

API Name*

Default Value: N/A
Example: clothing_c

String/Expression

Appears when you select Custom Objects for Marketo Entity.

Specify the Custom Object API name for which you must extract data.

Include export ID

Default ValueDeselected

Checkbox

None

Select this checkbox to display the export ID in the output.

Timeout (seconds)


Default Value0
Example: 1000

String/Expression

None

Specify the time in seconds to wait for the bulk extract to complete before it times out. A value of zero disables the timeout.

Number of Retries

Default Value0
Example: 3

String/Expression

None

Specify the number of attempts the Snap must make in case of connection failure or timeout.

Retry Interval (seconds)


Default Value1
Example: 4

String/Expression

None

Specify the minimum number of seconds the Snap must wait before each retry attempt.

Snap Execution

Default ValueValidate & Execute
Example: Execute only

Dropdown list

None

Select one of the following three modes in which the Snap executes:

  • Validate & Execute: Performs limited execution of the Snap, and generates a data preview during Pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during Pipeline runtime.

  • Execute only: Performs full execution of the Snap during Pipeline execution without generating preview data.

  • Disabled: Disables the Snap and all Snaps that are downstream from it.

Example

Extracting Data For Selective Fields For Program Members

This Pipeline demonstrates how to extract data for selected fields for Program Members - entity.

First, configure the Mapper Snap with the fields you want to extract for Program Members. You need to mention the start and the end date between which the records are updated for Program Members.

Configure the Marketo Bulk Extract Snap with Program Members for Marketo Entity for extracting the data for the specified fields for this entity.

On validation, Snap extracts data for the fields mapped. If a requested program member field is empty (contains no data), then a null value appears in the corresponding field in the output as below.

Download this Pipeline. 

  File Modified
No files shared here yet.

Downloads

  1. Download and import the Pipeline into SnapLogic.

  2. Configure Snap accounts, as applicable.

  3. Provide Pipeline parameters, as applicable.

Snap Pack History

 Click here to expand...

Release

Snap Pack Version 

Date

Type

Updates

May 2024

main26341

Stable

Updated and certified against the current SnapLogic Platform release.

February 2024

436patches25142

Latest

Fixed an issue with the Marketo Bulk Import and Bulk Lead Extract Snaps where the timeout was not disabled when the Timeout setting was set to 0.

February 2024

main25112

Stable

Updated and certified against the current SnapLogic Platform release.

November 2023

435patches24804

Latest

Fixed an issue with the Marketo Bulk Extract Snap where the timeout was not disabled when the Timeout setting was set to 0.

November 2023

435patches24332

Latest

Enhanced the Marketo Asset Read Snap to enable pagination when the maxReturn input query parameter value exceeds 200. We recommend you to set the maxReturn value to 0 or a large integer to fetch all the records.

November 2023

435patches24248

Latest

  • Enhanced the Marketo Bulk Extract Snap by adding the Include export ID checkbox. When you select this option, the Snap displays the export ID in the output.

  • Added support to Marketo Bulk Lead Extract to display the Export ID in the output.

November 2023

main23721

Stable

Updated and certified against the current SnapLogic Platform release.

August 2023

434patches22837

Latest

Updated the input and output schema for the Marketo Snaps.

August 2023

main22460

Stable

Updated and certified against the current SnapLogic Platform release.

May 2023

433patches21541

Latest

Fixed an issue with the Bulk Extract and Bulk Import Snaps where the API name was inaccessible when expressions were enabled for the Marketo Entity field and Custom Objects were selected.

May 2023

433patches21295

Latest

Fixed an issue with the Marketo Bulk Extract Snap where the Snap failed to extract data from the CSV file when the data consisted of the backslash (\) character.

May 2023

main21015

Stable

Upgraded with the latest SnapLogic Platform release.

February 2023

432patches20585

 

Latest

The Marketo Bulk Extract Snap works successfully in the non-lineage path within an Ultra task.

February 2023

main19844

 

Stable

Upgraded with the latest SnapLogic Platform release.

November 2022

431patches19248

 

Latest

The Marketo Lead Read Snap includes a new Read All Pages checkbox, which enables you to fetch all records for a selected command.

November 2022

431patches18969

 

Latest

The Marketo Bulk Import Snap now imports data for the selected Custom Objects. It also displays an error for invalid data or a mismatch of data type.

November 2022

main18944

 

Stable

 Ensure that the query parameters are unique and not defined in both input documents and properties.

October 2022

430patches18810

 

Latest

The Marketo Asset Write Snap no longer fails with 601 and 602 errors when the OAuth access token expires or is invalid.

October 2022

430patches18707

 

Latest

August 2022

main17386

 

Stable

Upgraded with the latest SnapLogic Platform release.

4.29 Patch

429patches16430

 

Latest

  • Fixed an issue with Marketo OAuth2 Account where the Snaps failed with ACCESS TOKEN EXPIRED error. Now the Snaps that use Marketo OAuth2 Account work as expected and does not display an expired token error.

  • Fixed an issue with Marketo Bulk Lead Upsert Snap where the Snap processed only successfully submitted batch jobs. Now, the Snap processes the failed batch jobs and logs the response message for each status.

  • Fixed an issue with Marketo Bulk Lead Upsert Snap where the Snap hung when parsing large data.

  • Fixed an issue with Marketo Bulk Lead Upsert and Bulk Lead Extract Snaps where the Snaps did not display valid error messages for Timeout and Number of Retries property when the input is large, empty, or Null.

  • Fixed an issue with Marketo Bulk Lead Upsert and Bulk Lead Extract Snaps where the Snaps failed without any reason when the Timeout value was less than 10 seconds.

4.29

main15993

 

Stable

Upgraded with the latest SnapLogic Platform release.

4.28

main14627

 

Stable

Enhanced the Bulk Lead Extract and Bulk Lead Upsert Snaps with retry mechanism fields to set a time limit to complete the processing of operations:

  • Timeout (seconds)

  • Number of Retries

  • Retry Interval (seconds)

4.27 Patch

427patches13147

 

Latest

Fixed an issue with the Asset Read, Lead Read, and Asset Write Snaps where the original payload was not passed through to the error view.

4.27 Patch

427patches12999

 

Latest

Fixed an issue where the Bulk Lead Extract and Bulk Lead Upsert Snaps failed when the Snaplexes were proxy-enabled.

4.27

main12833

 

Stable

Upgraded with the latest SnapLogic Platform release.

4.26 Patch

426patches11555

Latest

Fixed an issue with the Marketo Lead Read Snap, wherein the Snap generated the same next page token anytime during the day.

4.26

 main11181

 

Stable

Upgraded with the latest SnapLogic Platform release.

4.25

main9554

 

Stable

No updates made.

4.24

main8556

 

Stable

No updates made.

4.23-Patches

423patches7812

 

  • Stable

  • Latest

Introduces the Marketo Snap Pack to enable automating the process of performing operations to the Asset database and Lead database that manage the potential data for an organization in the marketing industry.


  • No labels