In this article

The page's title should always be the Snap's name.  For example, File Reader. 

Overview

Use this Snap to add the SELECT DISTINCT SQL statement to the query coming from the upstream Snap. The SELECT DISTINCT SQL statement is used to fetch unique records from the table or eliminate duplicates in the output. This Snap also allows you to preview the result of the SELECT DISTINCT SQL statement on the incoming SQL query. You can validate the modified query using this preview functionality.


You can use this Snap remove duplicates from the outputs of any ELT Snap such as ELT Select, ELT Intersect, and ELT Join. 

Prerequisites

None.

Limitation

Known Issues

Snap Input and Output

Type of view: Document/Binary/Both. Get number of views from the Views tab in the Snap. List at least three compatible Snaps in each category. Provide a brief of the input/output required. If the input/output is optional then preface the description with "Optional." For example, "Transaction data complying with the Orderful schema as a JSON document."

Input/OutputType of ViewNumber of ViewsExamples of Upstream and Downstream SnapsDescription
Input 

Document

  • Min: 1
  • Max: 1
  • ELT Select
  • ELT Intersect
  • ELT Aggregate
The SQL query in which you want to add the SELECT DISTINCT statement. 
Output

Document

  • Min: 1
  • Max: 1
  • ELT Insert-Select
  • ELT Merge Into
The SELECT DISTINCT statement added to the incoming query. 

Snap Settings

Parameter NameData TypeDescriptionDefault ValueExample 
LabelString
ELT UniqueDistinct Records
Get preview dataCheck boxNot selectedSelected

Troubleshooting

None.

Examples

Retrieving Distinct Values 

We need a SELECT DISTINCT query to retrieve distinct values from a table. This example shows how we can use a combination of the ELT Select and ELT Unique Snaps to accomplish this task.

 

First, we build a SELECT query to read the target table. To do so, we can use an ELT Select Snap. This Snap is configured to output a SELECT * query to read the target table in the database. Additionally, this Snap is also configured to show a preview of the SELECT query's execution:

A preview of the output from the ELT Select Snap is shown below:

Then, we add an ELT Unique Snap to the ELT Select Snap. Upon execution, the ELT Unique Snap adds the SELECT DISTINCT statement to the incoming query as shown:

We can also add an ELT Insert-Select Snap downstream and write the result of this query into another table.

Download this Pipeline.

Downloads

  1. Download and import the Pipeline into SnapLogic.
  2. Configure Snap accounts as applicable.
  3. Provide Pipeline parameters as applicable.



Edit the Excerpt Include macro below to link to the Snap Pack page for this Snap page. Ensure that the heading Snap Pack History is not within the Snap Pack's history Excerpt. 

See Also

Provide links to the endpoint's official documentation, any relevant or related internal documentation, and any other links you have referred to on this page. Care should be taken when referencing external sites/documentation that it is an official site/documentation. Do not refer to forums such as stackoverflow.