...
Field Name | Field Type | Field Dependency | Description | |
|---|---|---|---|---|
Label* Default Value: BigQuery Table Create | String/Expression | None | Specify a unique name for the Snap. Modify this to be more specific, especially if you have more than one Snap of the same type in your pipeline. | |
Project ID Default Value: N/A | String/Expression/Suggestion | None | Specify the project ID in which the dataset resides. | |
Dataset ID Default Value: N/A | String/Expression/Suggestion | None | Specify the dataset ID of the destination. | |
Table ID Default Value: N/A | String/Expression/Suggestion | None | Specify the table ID of the table you are creating. This is a unique ID that you must provide (it is not automatically created or assigned). Learn more about creating valid BigQuery table names. | |
Table Schema (JSON) | String | None | Enter the JSON schema for the table. | |
Detailed Information Default value: Deselected | Checkbox | None | Select this checkbox to enable the Snap to access additional fields for displaying them in the output. | |
Default table expiration (in days) | String/Expression | Appears when you select the Detailed Information checkbox. | New tables created in this dataset will be automatically deleted in the number of days specified. | |
Partitioning | Use this field set to define partitioning requirements. | |||
Enable partitioning Default Value: Deselected | Checkbox | Appears when you select the Partitioning dropdown. | Select to configure partitioning. | |
Require partitioning filter Default Value: Deselected | Checkbox | Appears when you select the Enable Partitioning checkbox. | Select to require users to include a WHERE clause that specifies the partitions to query each time they query the table. Select the partitioning type (time or range) and the partitioning time (time interval after which a new partition is created). | |
Clustering | Use this field set to define clustering requirements. | |||
Enable clustering Default Value: Deselected | Checkbox | Appears when you select the Clustering dropdown. | Select to configure clustering. | |
Snap Execution Default Value: Validate & Execute | Dropdown list | None | Select one of the following three modes in which the Snap executes:
| |
Examples
Creating a BigQuery Table
This example demonstrates how to create a table from a BigQuery dataset.
Configure the Snap with the Project ID, Dataset ID, Table ID, and Table schema in JSON format.
...
On validation, the Snap lists information about the newly created table in the output.
...
Creating a BigQuery Table After Filtering the Dataset
This example pipeline demonstrates how to read tables from a BigQuery dataset and create a new table from the filtered the dataset.
...
First, configure the BigQuery Table List Snap with the Project ID and Dataset ID of the dataset from which the table data is to be listed.
...
On validation, the Snap lists the tables in the dataset.
...
Next, configure the Filter Snap with an expression that filters the data to limit it to just the Inventory table: $table_id=="Inventory"
...
On validation, the Snap lists information about the filtered data in the output.
...
Configure the Table Create Snap with the Project ID, Dataset ID, Table ID, and Table schema in JSON format.
...
On validation, the Snap lists information about the newly created table in the output.
...
Downloads
| Info |
|---|
|
...