Label

Default Value: BigQuery Bulk Upsert (Streaming)
Example: GBQ Load Employee Tables

String

Specify the name for the Snap. You can modify this to be more specific, especially if you have more than one of the same Snap in your pipeline.

Project ID

Default Value: N/A
Example:test-project-12345

String/Expression/Suggestion

Specify the project ID in which the dataset resides.

Dataset ID

Default Value: N/A

Example: dataset-12345

String/Expression/Suggestion

Specify the dataset ID of the destination.

Table ID

Default Value: N/A

Example: table-12345

String/Expression/Suggestion

Specify the table ID of the table you are creating.

Batch size

String

The number of records batched per request. If the input has 10,000 records and the batch size is set to 100, the total number of requests would be 100.

Default value: 1000

Batch timeout (milliseconds)

String

Time in milliseconds after which the batch will be processed (even though it might be less than the specified batch size).

Default value: 2000

Batch timeout value must be set with care. When this limit is reached, the batch will be flushed whether or not all the records in the batch were loaded.

Batch retry count

String

The number of times the server should try to load a failed batch.

Default value: 0

Batch retry delay (milliseconds)

String

The time delay between each retry.

Default value: 500

Snap Execution

Default Value: Validate & Execute
Example: Execute only

Dropdown list

Select one of the three modes in which the Snap executes. Available options are:

• Validate & Execute: Performs limited execution of the Snap, and generates a data preview during Pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during Pipeline runtime.

• Execute only: Performs full execution of the Snap during Pipeline execution without generating preview data.

• Disabled: Disables the Snap and all Snaps that are downstream from it.