Versions Compared

Old Version 3

changes.mady.by.user Sandhya Sriram

Saved on

compared with

New Version 4

changes.mady.by.user Sandhya Sriram

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

In this article

...

You can use this Snap to create BigQuery Datasets. Datasets are top-level containers that you can use to organize and control access to your tables and views.

...

Snap Type

BigQuery Dataset Create Snap is a WRITE-type Snap that creates BigQuery Dataset.

...

Limitations

<<Notes to the reviewer - Including the generic limitations of BigQuery datasets. Kindly confirm which one to keep.>>

  • You can set the geographic location only at the time of creating a dataset. After you create the dataset, the location becomes immutable.

  • Dataset names must be unique for each project.

  • A dataset is contained within a specific project. A table or view must belong to a dataset, so you need to create at least one dataset before loading data into BigQuery.

  • All tables that are referenced in a query must be stored in datasets in the same location. (This can be used for Dataset List - your view)

  • When you copy a table, the datasets that contain the source table and destination table must reside in the same location.

...

Field Name

Field Type

Field Dependency

Description

Label*

Default Value: BigQuery Dataset Create
Example: BigQuery_Dataset_Create

String

None

Specify a unique name for the Dataset that is to be created.

Info

Dataset names must be unique for each project.

Project ID*

Default Value: None
Example: case16370

String/Expression

None

Specify the Project ID in which the dataset is to be created.

Dataset ID*

Default Value: None
Example: dscreate5

String/Expression

None

Specify the Project ID in which the dataset is to be created.

Detailed Information

Default Value: Deselected
Example: Selected

Checkbox

None

Select this checkbox to enable allow the Snap to display additional fields which are can be included while creating the dataset.

Location

Default Value: None
Example: Europe - Finland (europe-north1)

String/Expression

Displays when Detailed Information is selected.

Specify the geographic location where you want to create the dataset.

Info

You can set the geographic location only at the time of creating a dataset. After you create the dataset, the location becomes immutable.

<<Note to the reviewer - If I don’t specify the location at the time of creating a dataset, is it possible to assign a location later? Where the dataset will be created when I don’t provide a location?>>

Default Table Expiration (in Days)

Default Value: None
Example: 10

String/Expression

Displays when Detailed Information is selected.

Specify the number of days after which any new table created in this dataset should be automatically deleted. You can use this field only if you want to create a dataset to store temporary data that is not to be preserved for longer.
If you want to preserve the tables for longer, then leave this field blank.

<<Note to the reviewer - is it only for table or for views too>>

Snap Execution

Default Value: 
Example: Validate & Execute

Dropdown list

N/A

Select one of the following three modes in which the Snap executes:

  • Validate & Execute: Performs limited execution of the Snap, and generates a data preview during Pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during Pipeline runtime.

  • Execute only: Performs full execution of the Snap during Pipeline execution without generating preview data.

  • Disabled: Disables the Snap and all Snaps that are downstream from it.

...