Overview

Use this Snap to add the SELECT DISTINCT SQL statement to the query coming from the upstream Snap. The SELECT DISTINCT SQL statement is used to fetch unique records from the table or eliminate duplicates in the output. This Snap also allows you to preview the result of the SELECT DISTINCT SQL statement on the incoming SQL query. You can validate the modified query using this preview functionality.

You can use this Snap remove duplicates from the outputs of any ELT Snap such as ELT Select, ELT Intersect, and ELT Join.

Prerequisites

None.

Limitation

Known Issues

Snap Input and Output

Input/Output	Type of View	Number of Views	Examples of Upstream and Downstream Snaps	Description

Input/Output	Type of View	Number of Views	Examples of Upstream and Downstream Snaps	Description
Input	Document	Min: 1 Max: 1	ELT Select ELT Intersect ELT Aggregate	The SQL query in which you want to add the SELECT DISTINCT statement.
Output	Document	Min: 1 Max: 1	ELT Insert-Select ELT Merge Into	The SELECT DISTINCT statement added to the incoming query.

Snap Settings

SQL Functions and Expressions for ELT

You can use the SQL Expressions and Functions supported for ELT to define your Snap or Account settings with the Expression symbol = enabled, where available. This list is common to all target CDWs supported. You can also use other expressions/functions that your target CDW supports.

Parameter Name	Data Type	Description	Default Value	Example

Parameter Name

Data Type

Description

Default Value

Example

Label

String

ELT Unique

Distinct Records

Get preview data

Check box

Not selected

Selected

Troubleshooting

None.

Examples

Retrieving Distinct Values

We need a SELECT DISTINCT query to retrieve distinct values from a table. This example shows how we can use a combination of the ELT Select and ELT Unique Snaps to accomplish this task.

First, we build a SELECT query to read the target table. To do so, we can use an ELT Select Snap. This Snap is configured to output a SELECT * query to read the target table in the database. Additionally, this Snap is also configured to show a preview of the SELECT query's execution:

A preview of the output from the ELT Select Snap is shown below:

Then, we add an ELT Unique Snap to the ELT Select Snap. Upon execution, the ELT Unique Snap adds the SELECT DISTINCT statement to the incoming query as shown:

We can also add an ELT Insert-Select Snap downstream and write the result of this query into another table.

Download this Pipeline.

Downloads

Important Steps to Successfully Reuse Pipelines

Download and import the Pipeline into SnapLogic.
Configure Snap accounts as applicable.
Provide Pipeline parameters as applicable.