Skip to end of banner
Go to start of banner

Bulk Lead Upsert

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 45 Current »

In this Article

Overview

You can use the Bulk Lead Upsert Snap to upsert a large number of leads into the Lead database.

Prerequisites

A valid account with the required permissions. For more info, see Roles and Permissions.

Support for Ultra Pipelines

Works in Ultra Pipelines

Limitations

  • API Limits: 

    • Daily Quota: The subscriptions are allocated 50,000 API calls per day (which resets daily at 12:00AM CST).

    • API Rate Limit: All Marketo APIs are rate-limited. The API access per instance is limited to 100 calls per 20 seconds.

    • Concurrency Limit:  You can make a maximum of 10 concurrent API calls.

  • Marketo supports a variety of objects for extraction, such as Bulk Custom Object Import, Bulk Lead Import, and Bulk Program Member Import; however, this Snap supports only Lead upsert objects. See Bulk Lead Import API for more information.

  • This Snap accepts values for the Timeout (seconds)Number of Retries, and Retry Interval (seconds) fields from Pipeline parameters only. These fields do not support values from upstream Snaps when you enable the expression icon.

Known Issues

  • Bulk Lead Upsert Snap fails with error 1006 for SSV file format as input.

  • Marketo Snaps do not support some special characters (for example, (𝖖𝖗𝖘𝖬𝖭𝖮𝗕𝗖𝘧𝘨𝘩𝛀𝛁𝛂𝛃𝛄𝛅𝛆𝛇,𝖗𝖘𝖬𝛌𝛗𝛘𝛙𝛴).

Snap Input and Output

Input/Output

Type of View

Number of Views

Examples of Upstream and Downstream Snaps

Description

Input 

Binary


  • Min: 0

  • Max: 2

  • Mapper Snap

  • File Reader

Requires the Upsert format and additional detail, if required, to insert or update a large number of records into the Lead database.

Output

Document


  • Min: 0

  • Max: 1

  • Mapper Snap

  • Copy Snap

Insertion of large leads into the Lead database.

Snap Settings 

  • Asterisk ( * ): Indicates a mandatory field.

  • Suggestion icon ( (blue star) ): Indicates a list that is dynamically populated based on the configuration.

  • Expression icon ( (blue star) ): Indicates the value is an expression (if enabled) or a static value (if disabled). Learn more about Using Expressions in SnapLogic.

  • Add icon ( (blue star) ): Indicates that you can add fields in the fieldset.

  • Remove icon ( (blue star) ): Indicates that you can remove fields from the fieldset.

Field Name

Field Type

Description

Label*

String

Specify a name for the Snap. You can modify this to be more specific, especially if you have more than one of the same Snap in your Pipeline.

Default ValueBulk Lead Upsert
ExampleBulk Lead Upsert

Timeout (seconds)

Integer/Expression

Specify the timeout for the operation in seconds.

Default Value0
Example3

Number Of Retries

Integer/Expression

Specify the number of attempts the Snap must make in case of connection failure or timeout.

Minimum value0

Default Value0
Example3

Retry Interval (seconds)

Integer/Expression

Specify the minimum number of seconds the Snap must wait before each retry attempt.

Minimum value1

Default Value1
Example3

Upsert format*

Dropdown list

Choose the file format of the extracted data. The available options are:

  • csv

  • tsv

Default ValueCSV
Exampletsv

Lookup Field

String/Emai/Integer/Expression

Enter the field to refine and narrow down your search. Use this field to find existing leads if you are performing an update operation.

You can use 'Id' only for update only operations.

Default Valueemail 
Examplecookies

List ID

Integer/Expression

Enter the ID of the static list to which you want to import lead data.

Default ValueN/A
Example150

Partition

String/Expression

Enter the name of the lead partition where you want to import the data.

Default ValueN/A
ExampleDefault

Snap Execution

Dropdown list

Select one of the three following modes in which the Snap executes:

  • Validate & Execute. Performs limited execution of the Snap and generates a data preview during Pipeline validation, then performs full execution of the Snap (unlimited records) during Pipeline runtime.

  • Execute only. Performs full execution of the Snap during Pipeline execution without generating preview data.

  • Disabled. Disables the Snap and all Snaps downstream from it.

Default ValueExecute Only
ExampleValidate and Execute

Troubleshooting

None.

Examples

Inserting Bulk Leads

This example Pipeline demonstrates how we can insert lead data in bulk into the Lead database using the Bulk Lead Upsert Snap. We build the Pipeline to automate the following activities:

  1. Read the binary data using the File Reader Snap.

  2. Insert data in bulk using the Bulk Lead Upsert Snap.

First, we configure the File Reader Snap to read binary data. The username.csv has been uploaded. Upon validation, we see the output with uploaded file details.

File Reader Input

File Reader Output

Next, we configure the Bulk Lead Upsert Snap as follows. Upon validation, we see an output confirming the insertion of data into the Lead database.

Bulk Lead Upsert Input

Bulk Lead Upsert Output

Download this Pipeline. 

Downloads

Important Steps to Successfully Reuse Pipelines

  1. Download and import the Pipeline into SnapLogic.

  2. Configure Snap accounts as applicable.

  3. Provide Pipeline parameters as applicable.

  File Modified
You are not logged in. Any changes you make will be marked as anonymous. You may want to Log In if you already have an account.
No files shared here yet.
  • Drag and drop to upload or browse for files
  • Snap Pack History

     Click here to expand...

    Release

    Snap Pack Version 

    Date

    Type

    Updates

    May 2024

    main26341

    Stable

    Updated and certified against the current SnapLogic Platform release.

    February 2024

    436patches25142

    Latest

    Fixed an issue with the Marketo Bulk Import and Bulk Lead Extract Snaps where the timeout was not disabled when the Timeout setting was set to 0.

    February 2024

    main25112

    Stable

    Updated and certified against the current SnapLogic Platform release.

    November 2023

    435patches24804

    Latest

    Fixed an issue with the Marketo Bulk Extract Snap where the timeout was not disabled when the Timeout setting was set to 0.

    November 2023

    435patches24332

    Latest

    Enhanced the Marketo Asset Read Snap to enable pagination when the maxReturn input query parameter value exceeds 200. We recommend you to set the maxReturn value to 0 or a large integer to fetch all the records.

    November 2023

    435patches24248

    Latest

    • Enhanced the Marketo Bulk Extract Snap by adding the Include export ID checkbox. When you select this option, the Snap displays the export ID in the output.

    • Added support to Marketo Bulk Lead Extract to display the Export ID in the output.

    November 2023

    main23721

    Stable

    Updated and certified against the current SnapLogic Platform release.

    August 2023

    434patches22837

    Latest

    Updated the input and output schema for the Marketo Snaps.

    August 2023

    main22460

    Stable

    Updated and certified against the current SnapLogic Platform release.

    May 2023

    433patches21541

    Latest

    Fixed an issue with the Bulk Extract and Bulk Import Snaps where the API name was inaccessible when expressions were enabled for the Marketo Entity field and Custom Objects were selected.

    May 2023

    433patches21295

    Latest

    Fixed an issue with the Marketo Bulk Extract Snap where the Snap failed to extract data from the CSV file when the data consisted of the backslash (\) character.

    May 2023

    main21015

    Stable

    Upgraded with the latest SnapLogic Platform release.

    February 2023

    432patches20585

     

    Latest

    The Marketo Bulk Extract Snap works successfully in the non-lineage path within an Ultra task.

    February 2023

    main19844

     

    Stable

    Upgraded with the latest SnapLogic Platform release.

    November 2022

    431patches19248

     

    Latest

    The Marketo Lead Read Snap includes a new Read All Pages checkbox, which enables you to fetch all records for a selected command.

    November 2022

    431patches18969

     

    Latest

    The Marketo Bulk Import Snap now imports data for the selected Custom Objects. It also displays an error for invalid data or a mismatch of data type.

    November 2022

    main18944

     

    Stable

     Ensure that the query parameters are unique and not defined in both input documents and properties.

    October 2022

    430patches18810

     

    Latest

    The Marketo Asset Write Snap no longer fails with 601 and 602 errors when the OAuth access token expires or is invalid.

    October 2022

    430patches18707

     

    Latest

    August 2022

    main17386

     

    Stable

    Upgraded with the latest SnapLogic Platform release.

    4.29 Patch

    429patches16430

     

    Latest

    • Fixed an issue with Marketo OAuth2 Account where the Snaps failed with ACCESS TOKEN EXPIRED error. Now the Snaps that use Marketo OAuth2 Account work as expected and does not display an expired token error.

    • Fixed an issue with Marketo Bulk Lead Upsert Snap where the Snap processed only successfully submitted batch jobs. Now, the Snap processes the failed batch jobs and logs the response message for each status.

    • Fixed an issue with Marketo Bulk Lead Upsert Snap where the Snap hung when parsing large data.

    • Fixed an issue with Marketo Bulk Lead Upsert and Bulk Lead Extract Snaps where the Snaps did not display valid error messages for Timeout and Number of Retries property when the input is large, empty, or Null.

    • Fixed an issue with Marketo Bulk Lead Upsert and Bulk Lead Extract Snaps where the Snaps failed without any reason when the Timeout value was less than 10 seconds.

    4.29

    main15993

     

    Stable

    Upgraded with the latest SnapLogic Platform release.

    4.28

    main14627

     

    Stable

    Enhanced the Bulk Lead Extract and Bulk Lead Upsert Snaps with retry mechanism fields to set a time limit to complete the processing of operations:

    • Timeout (seconds)

    • Number of Retries

    • Retry Interval (seconds)

    4.27 Patch

    427patches13147

     

    Latest

    Fixed an issue with the Asset Read, Lead Read, and Asset Write Snaps where the original payload was not passed through to the error view.

    4.27 Patch

    427patches12999

     

    Latest

    Fixed an issue where the Bulk Lead Extract and Bulk Lead Upsert Snaps failed when the Snaplexes were proxy-enabled.

    4.27

    main12833

     

    Stable

    Upgraded with the latest SnapLogic Platform release.

    4.26 Patch

    426patches11555

    Latest

    Fixed an issue with the Marketo Lead Read Snap, wherein the Snap generated the same next page token anytime during the day.

    4.26

     main11181

     

    Stable

    Upgraded with the latest SnapLogic Platform release.

    4.25

    main9554

     

    Stable

    No updates made.

    4.24

    main8556

     

    Stable

    No updates made.

    4.23-Patches

    423patches7812

     

    • Stable

    • Latest

    Introduces the Marketo Snap Pack to enable automating the process of performing operations to the Asset database and Lead database that manage the potential data for an organization in the marketing industry.




    • No labels