Bulk Lead Extract

In this Article

Overview

You can use the Bulk Lead Extract Snap to fetch large number of leads from the Lead database.

Prerequisites

A valid account with the required permissions. For more info, see Roles and Permissions.

Support for Ultra Pipelines

Works in Ultra Pipelines

Limitations

  • Out of the variety of filter types that Marketo supports, this Snap supports only createdAt filter type which uses a date range (start and end dates) for bulk extraction of leads.

Known Issues

  • This Snap results to empty output if you select the JSON format. The preview result is displayed only if you select the Table format.

  • Marketo Snaps do not support some special characters (for example, (𝖖𝖗𝖘𝖬𝖭𝖮𝗕𝗖𝘧𝘨𝘩𝛀𝛁𝛂𝛃𝛄𝛅𝛆𝛇,𝖗𝖘𝖬𝛌𝛗𝛘𝛙𝛴).

Snap Input and Output

Input/Output

Type of View

Number of Views

Examples of Upstream and Downstream Snaps

Description

Input/Output

Type of View

Number of Views

Examples of Upstream and Downstream Snaps

Description

Input 

Document

  • Min: 0

  • Max: 1

  • Mapper

Requires the Export format with Start and End date to retrieve leads from Lead database.

Output

Binary

  • Min: 0

  • Max: 1

  • File Writer

  • Mapper

The exported data from Lead database.

Snap Settings

  • Asterisk ( * ): Indicates a mandatory field.

  • Suggestion icon ( ): Indicates a list that is dynamically populated based on the configuration.

  • Expression icon ( ): Indicates the value is an expression (if enabled) or a static value (if disabled). Learn more about Using Expressions in SnapLogic.

  • Add icon ( ): Indicates that you can add fields in the fieldset.

  • Remove icon ( ): Indicates that you can remove fields from the fieldset.

Field Name

Field Type

Description

Field Name

Field Type

Description

Label*

String

Specify a name for the Snap. You can modify this to be more specific, especially if you have more than one of the same Snap in your Pipeline.

Default Value: Bulk Lead Extract
ExampleExtract Data

Timeout (seconds)

Integer/Expression

Specify the timeout for the operation in seconds.

Default Value0
Example3

Number of Retries

Integer/Expression

Specify the number of attempts the Snap must make in case of connection failure or timeout.

Minimum value0

Default Value0
Example3

Retry Interval (seconds)

Integer/Expression

Specify the minimum number of seconds the Snap must wait before each retry attempt.

Minimum value1

Default Value1
Example3

Export format*

Dropdown list

Select the file format of the extracted data. The available options are as follows:

  • csv

  • tsv

  • ssv

Default Valuecsv
Exampletsv

Start date*

String/Date/Expression

Specify the date value (the date from which you want to extract records) you desire to extract data. This enables the Snap to extract data from the specified date. See the example below for more information.

Currently, the only supported format is YYYY-MM-DD as a string.

Default Value: N/A
Example2020-11-03

End date*

String/Date/Expression

Enter the end date (of the date range) till which you want to extract the data. This enables the Snap to extract data until the specified date.

Currently, the only supported format is YYYY-MM-DD as a string.

Default Value: N/A
Example2020-11-30

Fields To Extract

Use this field set to specify output fields while extracting data from the Lead database. This field set contains the Output Fields field. One output field row is added by default. Click  to add more rows for output fields.. Add each output field in a separate row.

Output Fields

String/Expression

Enter the field to display in the exported file.

Default Value: N/A
ExamplelastName

Snap Execution

Dropdown list

Select one of the three following modes in which the Snap executes:

  • Validate & Execute. Performs limited execution of the Snap and generates a data preview during Pipeline validation, then performs full execution of the Snap (unlimited records) during Pipeline runtime.

  • Execute only. Performs full execution of the Snap during Pipeline execution without generating preview data.

  • Disabled. Disables the Snap and all Snaps downstream from it.

Default ValueValidate and Execute
ExampleValidate and Execute

Troubleshooting

Error

Reason

Resolution

Error

Reason

Resolution

''Failure: Export ID was not returned by Marketo"

The export ID is missing.

Ensure that you use valid login credentials.

Examples

Extraction of Data

This example Pipelines demonstrates how we can extract data in bulk from the Lead database using the Bulk Lead Extract Snap. We build the Pipeline to automate the following activities:

  1. Extract data in bulk using Bulk Lead Extract Snap.

  2. Write the binary data to an end point using File Writer Snap.

Initially, we configure the Bulk Lead Extract Snap as follows. Note that Export format, Start and End dates fields are mandatory. Additionally, you can provide specific fields to export from the database under Output Fields.

Bulk Lead Extract Input

Bulk Lead Extract Input

Next, we configure the File Writer Snap to write binary data to an end point.

File Writer Input

File Writer Input

Upon execution, we see the extracted data with the proposed fields as output.

File Writer Output

File Writer Output

Download this Pipeline. 

Extracting Leads Data Created Within A Specific Date Range

This is a simple example of a stand-alone Pipeline that demonstrates how we can extract data of leads created during a specific date range. This example assumes that you have configured a valid Marketo account to be used with this Snap.

We configure the Bulk Lead Extract Snap to extract the leads created during 2021-08-01 to 2021-08-11. We also want to extract the id, first name, last name, created at, and updated at fields to view in the output.


Upon validation, this Snap generates the leads data created during the specified date range.


Downloads

  File Modified

File Marketo_Bulk Extract.slp

Dec 09, 2020 by Siddharth Menon

Snap Pack History