Skip to end of banner
Go to start of banner

Bulk Lead Extract

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 37 Current »

In this Article

Overview

You can use the Bulk Lead Extract Snap to fetch large number of leads from the Lead database.

Prerequisites

A valid account with the required permissions. For more info, see Roles and Permissions.

Support for Ultra Pipelines

Works in Ultra Pipelines

Limitations

  • Daily Quota: The subscriptions are allocated 50,000 API calls per day (which resets daily at 12:00AM CST).

  • API Rate Limit: All Marketo APIs are rate-limited. The API access per instance is limited to 100 calls per 20 seconds.

  • Concurrency Limit:  You can make a maximum of 10 concurrent API calls.

  • Out of the variety of filter types that Marketo supports, this Snap supports only createdAt filter type which uses a date range (start and end dates) for bulk extraction of leads.

Known Issues

  • This Snap results to empty output if you select the JSON format. The preview result is displayed only if you select the Table format.

  • Marketo Snaps do not support some special characters (for example, (𝖖𝖗𝖘𝖬𝖭𝖮𝗕𝗖𝘧𝘨𝘩𝛀𝛁𝛂𝛃𝛄𝛅𝛆𝛇,𝖗𝖘𝖬𝛌𝛗𝛘𝛙𝛴).

Snap Input and Output

Input/Output

Type of View

Number of Views

Examples of Upstream and Downstream Snaps

Description

Input 

Document

  • Min: 0

  • Max: 1

  • Mapper

Requires the Export format with Start and End date to retrieve leads from Lead database.

Output

Binary

  • Min: 0

  • Max: 1

  • File Writer

  • Mapper

The exported data from Lead database.

Snap Settings

  • Asterisk ( * ): Indicates a mandatory field.

  • Suggestion icon ( (blue star) ): Indicates a list that is dynamically populated based on the configuration.

  • Expression icon ( (blue star) ): Indicates the value is an expression (if enabled) or a static value (if disabled). Learn more about Using Expressions in SnapLogic.

  • Add icon ( (blue star) ): Indicates that you can add fields in the fieldset.

  • Remove icon ( (blue star) ): Indicates that you can remove fields from the fieldset.

Field Name

Field Type

Description

Label*

String

Specify a name for the Snap. You can modify this to be more specific, especially if you have more than one of the same Snap in your Pipeline.

Default Value: Bulk Lead Extract
ExampleExtract Data

Timeout (seconds)

Integer/Expression

Specify the timeout for the operation in seconds.

Default Value0
Example3

Number of Retries

Integer/Expression

Specify the number of attempts the Snap must make in case of connection failure or timeout.

Minimum value0

Default Value0
Example3

Retry Interval (seconds)

Integer/Expression

Specify the minimum number of seconds the Snap must wait before each retry attempt.

Minimum value1

Default Value1
Example3

Export format*

Dropdown list

Select the file format of the extracted data. The available options are as follows:

  • csv

  • tsv

  • ssv

Default Valuecsv
Exampletsv

Start date*

String/Date/Expression

Specify the date value (the date from which you want to extract records) you desire to extract data. This enables the Snap to extract data from the specified date. See the example below for more information.

Currently, the only supported format is YYYY-MM-DD as a string.

Default Value: N/A
Example2020-11-03

End date*

String/Date/Expression

Enter the end date (of the date range) till which you want to extract the data. This enables the Snap to extract data until the specified date.

Currently, the only supported format is YYYY-MM-DD as a string.

Default Value: N/A
Example2020-11-30

Fields To Extract

Use this field set to specify output fields while extracting data from the Lead database. This field set contains the Output Fields field. One output field row is added by default. Click  to add more rows for output fields.. Add each output field in a separate row.

Output Fields

String/Expression

Enter the field to display in the exported file.

Default Value: N/A
ExamplelastName

Snap Execution

Dropdown list

Select one of the three following modes in which the Snap executes:

  • Validate & Execute. Performs limited execution of the Snap and generates a data preview during Pipeline validation, then performs full execution of the Snap (unlimited records) during Pipeline runtime.

  • Execute only. Performs full execution of the Snap during Pipeline execution without generating preview data.

  • Disabled. Disables the Snap and all Snaps downstream from it.

Default ValueValidate and Execute
ExampleValidate and Execute

Troubleshooting

Error

Reason

Resolution

''Failure: Export ID was not returned by Marketo"

The export ID is missing.

Ensure that you use valid login credentials.

Examples

Extraction of Data

This example Pipelines demonstrates how we can extract data in bulk from the Lead database using the Bulk Lead Extract Snap. We build the Pipeline to automate the following activities:

  1. Extract data in bulk using Bulk Lead Extract Snap.

  2. Write the binary data to an end point using File Writer Snap.

Initially, we configure the Bulk Lead Extract Snap as follows. Note that Export format, Start and End dates fields are mandatory. Additionally, you can provide specific fields to export from the database under Output Fields.

Bulk Lead Extract Input

Next, we configure the File Writer Snap to write binary data to an end point.

File Writer Input

Upon execution, we see the extracted data with the proposed fields as output.

File Writer Output

Download this Pipeline. 

Extracting Leads Data Created Within A Specific Date Range

This is a simple example of a stand-alone Pipeline that demonstrates how we can extract data of leads created during a specific date range. This example assumes that you have configured a valid Marketo account to be used with this Snap.

We configure the Bulk Lead Extract Snap to extract the leads created during 2021-08-01 to 2021-08-11. We also want to extract the id, first name, last name, created at, and updated at fields to view in the output.

Upon validation, this Snap generates the leads data created during the specified date range.

Downloads

Important Steps to Successfully Reuse Pipelines

  1. Download and import the Pipeline into SnapLogic.

  2. Configure Snap accounts as applicable.

  3. Provide Pipeline parameters as applicable.

  File Modified
You are not logged in. Any changes you make will be marked as anonymous. You may want to Log In if you already have an account.
No files shared here yet.
  • Drag and drop to upload or browse for files
  • Snap Pack History

     Click here to expand...

    Release

    Snap Pack Version 

    Date

    Type

    Updates

    May 2024

    main26341

    Stable

    Updated and certified against the current SnapLogic Platform release.

    February 2024

    436patches25142

    Latest

    Fixed an issue with the Marketo Bulk Import and Bulk Lead Extract Snaps where the timeout was not disabled when the Timeout setting was set to 0.

    February 2024

    main25112

    Stable

    Updated and certified against the current SnapLogic Platform release.

    November 2023

    435patches24804

    Latest

    Fixed an issue with the Marketo Bulk Extract Snap where the timeout was not disabled when the Timeout setting was set to 0.

    November 2023

    435patches24332

    Latest

    Enhanced the Marketo Asset Read Snap to enable pagination when the maxReturn input query parameter value exceeds 200. We recommend you to set the maxReturn value to 0 or a large integer to fetch all the records.

    November 2023

    435patches24248

    Latest

    • Enhanced the Marketo Bulk Extract Snap by adding the Include export ID checkbox. When you select this option, the Snap displays the export ID in the output.

    • Added support to Marketo Bulk Lead Extract to display the Export ID in the output.

    November 2023

    main23721

    Stable

    Updated and certified against the current SnapLogic Platform release.

    August 2023

    434patches22837

    Latest

    Updated the input and output schema for the Marketo Snaps.

    August 2023

    main22460

    Stable

    Updated and certified against the current SnapLogic Platform release.

    May 2023

    433patches21541

    Latest

    Fixed an issue with the Bulk Extract and Bulk Import Snaps where the API name was inaccessible when expressions were enabled for the Marketo Entity field and Custom Objects were selected.

    May 2023

    433patches21295

    Latest

    Fixed an issue with the Marketo Bulk Extract Snap where the Snap failed to extract data from the CSV file when the data consisted of the backslash (\) character.

    May 2023

    main21015

    Stable

    Upgraded with the latest SnapLogic Platform release.

    February 2023

    432patches20585

     

    Latest

    The Marketo Bulk Extract Snap works successfully in the non-lineage path within an Ultra task.

    February 2023

    main19844

     

    Stable

    Upgraded with the latest SnapLogic Platform release.

    November 2022

    431patches19248

     

    Latest

    The Marketo Lead Read Snap includes a new Read All Pages checkbox, which enables you to fetch all records for a selected command.

    November 2022

    431patches18969

     

    Latest

    The Marketo Bulk Import Snap now imports data for the selected Custom Objects. It also displays an error for invalid data or a mismatch of data type.

    November 2022

    main18944

     

    Stable

     Ensure that the query parameters are unique and not defined in both input documents and properties.

    October 2022

    430patches18810

     

    Latest

    The Marketo Asset Write Snap no longer fails with 601 and 602 errors when the OAuth access token expires or is invalid.

    October 2022

    430patches18707

     

    Latest

    August 2022

    main17386

     

    Stable

    Upgraded with the latest SnapLogic Platform release.

    4.29 Patch

    429patches16430

     

    Latest

    • Fixed an issue with Marketo OAuth2 Account where the Snaps failed with ACCESS TOKEN EXPIRED error. Now the Snaps that use Marketo OAuth2 Account work as expected and does not display an expired token error.

    • Fixed an issue with Marketo Bulk Lead Upsert Snap where the Snap processed only successfully submitted batch jobs. Now, the Snap processes the failed batch jobs and logs the response message for each status.

    • Fixed an issue with Marketo Bulk Lead Upsert Snap where the Snap hung when parsing large data.

    • Fixed an issue with Marketo Bulk Lead Upsert and Bulk Lead Extract Snaps where the Snaps did not display valid error messages for Timeout and Number of Retries property when the input is large, empty, or Null.

    • Fixed an issue with Marketo Bulk Lead Upsert and Bulk Lead Extract Snaps where the Snaps failed without any reason when the Timeout value was less than 10 seconds.

    4.29

    main15993

     

    Stable

    Upgraded with the latest SnapLogic Platform release.

    4.28

    main14627

     

    Stable

    Enhanced the Bulk Lead Extract and Bulk Lead Upsert Snaps with retry mechanism fields to set a time limit to complete the processing of operations:

    • Timeout (seconds)

    • Number of Retries

    • Retry Interval (seconds)

    4.27 Patch

    427patches13147

     

    Latest

    Fixed an issue with the Asset Read, Lead Read, and Asset Write Snaps where the original payload was not passed through to the error view.

    4.27 Patch

    427patches12999

     

    Latest

    Fixed an issue where the Bulk Lead Extract and Bulk Lead Upsert Snaps failed when the Snaplexes were proxy-enabled.

    4.27

    main12833

     

    Stable

    Upgraded with the latest SnapLogic Platform release.

    4.26 Patch

    426patches11555

    Latest

    Fixed an issue with the Marketo Lead Read Snap, wherein the Snap generated the same next page token anytime during the day.

    4.26

     main11181

     

    Stable

    Upgraded with the latest SnapLogic Platform release.

    4.25

    main9554

     

    Stable

    No updates made.

    4.24

    main8556

     

    Stable

    No updates made.

    4.23-Patches

    423patches7812

     

    • Stable

    • Latest

    Introduces the Marketo Snap Pack to enable automating the process of performing operations to the Asset database and Lead database that manage the potential data for an organization in the marketing industry.




    • No labels