In this article

Overview

You can use this Snap to read and retrieve data from a Google BigQuery table.

Snap Type

The Google BigQuery Table Data List Snap is a Read-type Snap that reads table data from the BigQuery dataset and lists the data in the output.

Prerequisites

A valid Google BigQuery account with the required permissions.

Limitations and Known Issues

None.

Support for Ultra Pipelines

Works in Ultra Pipelines.

Snap Views

Type

Format

Number of Views

Examples of Upstream and Downstream Snaps

Description

Input

Document

Min: 0
Max: 1

Mapper
JSON Generator

The Project ID and the Document ID.

Output

Document

Min: 1
Max: 1

JSON Parser
File Writer

The list of Table IDs along with their Project IDs, Dataset IDs, and Table type.

Error

Error handling is a generic way to handle errors without losing data or failing the Snap execution. You can handle the errors that the Snap might encounter when running the Pipeline by choosing one of the following options from the When errors occur list under the Views tab:

Stop Pipeline Execution: Stops the current Pipeline execution if the Snap encounters an error.
Discard Error Data and Continue: Ignores the error, discards that record, and continues with the remaining records.
Route Error Data to Error View: Routes the error data to an error view without stopping the Snap execution.

Learn more about Error handling in Pipelines.

Snap Settings

Asterisk ( * ): Indicates a mandatory field.
Suggestion icon (): Indicates a list that is dynamically populated based on the configuration.
Expression icon ( ): Indicates the value is an expression (if enabled) or a static value (if disabled). Learn more about Using Expressions in SnapLogic.
Add icon ( ): Indicates that you can add fields in the field set.
Remove icon ( ): Indicates that you can remove fields from the field set.
Upload icon ( ): Indicates that you can upload files.

Field Name	Field Type	Field Dependency	Description
Label* Default Value: BigQuery Table Data List Example: Sales Leads Data List	String/Expression	None.	Enter a unique name for the Snap. You can modify this to be more specific, especially if you have more than one of the same Snap in your pipeline.
Project ID Default Value: N/A Example: test-project-12345	String/Expression/Suggestion	None.	Specify the project ID in which the dataset resides.
Dataset ID Default Value: N/A Example: dataset-12345	String/Expression/Suggestion	None.	Specify the dataset ID of the destination.
Table ID Default Value: N/A Example: table-12345	String/Expression/Suggestion	None.	Specify the table ID of the table you are creating.
Snap Execution Default Value: Validate & Execute Example: Disabled	Dropdown list	None.	Select one of the following three modes in which the Snap executes: Validate & Execute: Performs limited execution of the Snap, and generates a data preview during pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during pipeline runtime. Execute only: Performs full execution of the Snap during pipeline execution without generating preview data. Disabled: Disables the Snap and all Snaps that are downstream from it.

Examples

Reading a BigQuery Dataset and Listing the Table Data

This example demonstrates how to read table data from a BigQuery dataset and list the data in the output.

Configure the Snap with the Project ID, Dataset ID, and Table ID of the dataset from which the table data is to be listed.

On validation, the Snap lists the table data in the output.

Reading a BigQuery Dataset and Listing the Table Data After Filtering the Dataset

This example pipeline demonstrates how to read tables from a BigQuery dataset and list the data from a specific table in the output.

Pipeline showing BigQuery Table List, Filter, and BigQuery Table Data List.

First, configure the BigQuery Table List Snap with the Project ID and Dataset ID of the dataset from which the table data is to be listed.

Settings for the Table List Snap (warehouse example)

On validation, the Snap lists the tables in the dataset.

Next, configure the Filter Snap with an expression that filters the data to limit it to just the Inventory table: $table_id=="Inventory"

Settings for the Filter Snap (filter by inventory table)

On validation, the Snap lists information about the filtered data in the output.

Configure the Table Data List Snap with the Project ID, Dataset ID, and Table ID of the dataset from which the table data is to be listed.