In this article
Table of Contents | ||||||
---|---|---|---|---|---|---|
|
Overview
You can use this Snap to list tables that are read from BigQuery dataset.
Snap Type
BigQuery Table List Snap is a Read-type Snap that reads the tables from the BigQuery dataset and lists them in the output.
Prerequisites
A valid Google BigQuery Account with the required permissions.
Support for Ultra Pipelines
Works in Ultra Pipelines.
Limitations and Known Issues
None.
Snap Views
Type | Format | Number of Views | Examples of Upstream and Downstream Snaps | Description |
---|---|---|---|---|
Input | Document |
|
| This Snap has at most one document input view. The Project ID and the Document ID. |
Output | Document |
|
| This Snap has exactly one document output view. The list of Table IDs along with their Project IDs, Dataset IDs, and Table type. |
Error | Error handling is a generic way to handle errors without losing data or failing the Snap execution. You can handle the errors that the Snap might encounter while running the Pipeline by choosing one of the following options from the When errors occur list under the Views tab:
Learn more about Error handling in Pipelines. |
Snap Settings
Info |
---|
|
Field Name | Field Type | Description |
---|---|---|
Label* Default Value: BigQuery Table List | String/Expression | Specify a unique name for the Snap. Modify this to be more specific, especially if you have more than one Snap of the same type in your Pipeline. |
Project ID Default Value: N/A | String/Expression/Suggestion | Specify the project ID in which the dataset |
Dataset ID Default Value: N/A | String/Expression/Suggestion | Specify the dataset ID of the destination. |
Detailed Information Default value: Deselected | Checkbox | Select this checkbox to enable the Snap to access additional fields for displaying them in the output. |
Snap Execution Default Value: Validate & Execute | Dropdown list | Select one of the following three modes in which the Snap executes:
|
Example
Reading a BigQuery Dataset and Listing the Tables
This example Pipeline demonstrates how to read tables from a BigQuery dataset and list the tables in the output.
Configure the Snap with the Project ID and the Dataset ID of the dataset from which the table names need to be listed.
On validation, the Snap lists the tables in the output.
Download this Pipeline.
Attachments | ||
---|---|---|
|
Downloads
Info |
---|
|
Attachments | ||||
---|---|---|---|---|
|
Insert excerpt | ||||||||
---|---|---|---|---|---|---|---|---|
|