AlloyDB Bulk Load
In this article
Overview
You can use this Snap to bulk load data into AlloyDB tables. If the target table does not exist in AlloyDB, you can create a table. This Snap supports both binary and document inputs. You can configure the input view in the Views tab.
Snap Type
The AlloyDB Bulk Load Snap is a Write-type Snap.
Prerequisites
None.
Support for Ultra Pipelines
Does not support Ultra Pipelines.
Limitations
If the target table does not exist and the input is binary, the Snap does not fetch the table's schema from the input. The table's schema must be passed to the Snap through the second input view.
Known Issues
None.
Behavior Changes
Snap Views
Type | Format | Number of Views | Examples of Upstream and Downstream Snaps | Description |
---|---|---|---|---|
Input |
|
|
| The data to be loaded into the AlloyDB table. This Snap has one document input view by default. A second view can be added for table metadata as a binary or document stream so that the target absent table can be created in the database with a schema similar to the source table. This schema is usually from the output of a database Select Snap. |
Output | Document
|
|
| The Snap outputs one document specifying the status, with the records count that are being inserted into the table. Any error occurring during the process is routed to the error view. |
Error | Error handling is a generic way to handle errors without losing data or failing the Snap execution. You can handle the errors that the Snap might encounter while running the Pipeline by choosing one of the following options from the When errors occur list under the Views tab:
Learn more about Error handling in Pipelines. |
Snap Settings
Asterisk ( * ): Indicates a mandatory field.
Suggestion icon (): Indicates a list that is dynamically populated based on the configuration.
Expression icon ( ): Indicates the value is an expression (if enabled) or a static value (if disabled). Learn more about Using Expressions in SnapLogic.
Add icon ( ): Indicates that you can add fields in the fieldset.
Remove icon ( ): Indicates that you can remove fields from the fieldset.
Upload icon ( ): Indicates that you can upload files.
Field Name | Field Type | Description | |
---|---|---|---|
Label*
Default Value: AlloyDB Bulk Load | String | Specify a unique name for the Snap.
| |
Schema
Default Value: N/A | String/Expression | Specify the database schema name in AlloyDB. If you do not specify a schema, then the suggestion for the Table name retrieves all table names of all schemas.
| |
Table name*
| String/Expression | Specify the AlloyDB table on which to run the bulk load operation.
| |
Create table if not present
| Checkbox | Select this checkbox to automatically create the target table if it does not exist.
A newly created table is not visible to subsequent database Snaps during runtime validation. If you want to immediately use the newly updated data you must use a child Pipeline that is invoked through a Pipeline Execute Snap. | |
Columns | Use this field set to define the columns to be loaded/copied. If you do not configure this field set, then all columns in the input data stream are loaded into the target table. You can also set how you want the Snap to handle null values for each column.
| ||
Column
| String/Expression | Specify the name of the column/field. This is a suggestible field and lists all field names in the input.
| |
Force Not-Null
| Checkbox | Select this checkbox to not match the selected column's value against the null string. The Snap reads empty null strings as zero-length strings rather than nulls, even when they are not quoted.
| |
Force Null
| Checkbox | Select this checkbox to match the selected column value against the null string, even if it has been quoted. If a match is found, the field value is set to NULL. By default, when the null string is empty, the Snap converts a quoted empty string into NULL.
| |
Format*
| Dropdown list | Choose the data format to be written. This field is applicable only when using the binary input view.
| |
Header Provided
| Checkbox | Select this checkbox to include the input data as a header. Applicable only when using the binary input view and CSV option in the Format field.
| |
Encoding
Default Value: UTF8 | Dropdown list | Choose one of the following encodings to use. This is limited to the encodings supported by the AlloyDB server: ABC ALT BIG5 EUC_CN EUC_JIS_2004 EUC_JP EUC_KR EUC_TW GB18030 GBK ISO88591 ISO885910 ISO885913 ISO885914 ISO885915 ISO885916 ISO88592 ISO88593 ISO88594 ISO88599 ISO_8859_5 ISO_8859_6 ISO_8859_7 ISO_8859_8 ISO_8859_8 JOHAB KOI8 KOI8R KOI8U LATIN1 LATIN2 LATIN3 LATIN4 LATIN5 LATIN7 LATIN9 Mskanji SHIFT_JIS_2004 SJIS SQL_ASCII ShiftJIS TCVN TCVN5712 UHC UTF8 Unicode VSCII WIN WIN1250 WIN1251 WIN1252 WIN1253 WIN1254 WIN1255 WIN1256 WIN1257 WIN1258 WIN866 WIN874 WIN932 WIN936 WIN949 WIN950 Windows932 Windows936 Windows949 Windows950 | |
Snap Execution Default Value: | Dropdown list | Select one of the following three modes in which the Snap executes:
|
Snap Pack History
Related Links
Have feedback? Email documentation@snaplogic.com | Ask a question in the SnapLogic Community
© 2017-2024 SnapLogic, Inc.