...
Deduplication of records using the Smart List is a straightforward approach, where you create the Smart List in the Marketo account. Next, you must configure the Smart List filter to fetch all the required records and provide the Smart List name/ID in the pipelines.
...
Download this pipeline.Step 1: Create a Smart List in the Marketo account. Navigate to the Database section and right-click on any folders and click New Smart List.
...
The Static List option is useful when you have a list of records from an external application such as Salesforce and want to import it to Marketo.
...
Download this pipeline.Step 1: Create a new list in your Marketo account.
...
The main or first pipeline takes the start date and the end date of the period for which the deduplication must be done. The first pipeline executes the child pipeline (2nd pipeline) to segregate the number of days into batches of 31 days (Marketo has a limitation to fetch records for 31 days using Bulk Extract Snap).
...
Download this pipeline.Configure the start date and end date for which the deduplication of records has to be done. Provide the start date and the end date in the pipeline parameters.
...
If the duplicate records do not contain the Person Source data, the records are merged seamlessly.
If the first record has Person Source data and the duplicate records do not, the latter is merged into the first.
If all the duplicates have the Person Source data, the latest records are merged into the older record.
...
Third Pipeline
...
Download this pipeline.The third pipeline bulk extracts the data for the specified period for the Leads entity.
...