...
Field Name | Field Type | Description | ||
|---|---|---|---|---|
Label* Default Value: Snowflake - Bulk Load | String | Specify the name for the instance. You can modify this to be more specific, especially if you have more than one of the same Snap in your Pipeline. | ||
Schema Name Default Value: N/A | String/Expression/Suggestion | Specify the database schema name. In case it is not defined, then the suggestion for the Table Name will retrieve all tables names of all schemas. The property is suggestible and will retrieve available database schemas during suggest values. The values can be passed using the pipeline parameters but not the upstream parameter. | ||
Table Name* Default Value: N/A | String/Expression/Suggestion | Specify the table on which to execute the bulk load operation.
Examples: | ||
Create table if not present Default Value: Deselected | Checkbox | Select this check box to enable the Snap to automatically create a table if a table does not exist. The data types for the columns in the new table depend on the data types coming from the upstream Snap. If a second input view exists, the Snap reads and uses the data types for the columns from this input view. | ||
BCP absolute path Default Value: N/A | String | Specify the absolute path of the bcp utility program in JCC's file system. If empty, the Snap looks for it in JCC's environment variable PATH. bcp.bat should include the ".exe" extension to ensure the executable is actually referenced. Handling Unrecognized Character sets in the Data set Since the Snaplex uses the OS's default character set, it cannot recognize characters in other languages. Due to this, unrecognized characters in the data set are replaced with junk values when performing bulk load operations. To mitigate this, create a bcp.bat file and include the following line:
Use the path to this bcp.bat file in the BCP absolute path. This is only applicable to Windows-based Snaplexes. | ||
Maximum error count* Default Value: 10 | Integer | Specify the maximum number of rows which can fail before the bulk load operation is stopped. | ||
Batch size Default Value: N/A | Integer/Expression | Specify the number of records batched per request. If the input has 10,000 records and the batch size is set to 100, the total number of requests batched would be 100. Minimum Value: 1 | ||
Snap Execution Default Value: Execute only | Dropdown list | Select one of the three modes in which the Snap executes. Available options are:
|
Troubleshooting
Problem:
Reason:
Resolution:
| Insert excerpt | ||||||
|---|---|---|---|---|---|---|
|
Troubleshooting Troubleshooting
Error | Reason | Resolution | ||||
|---|---|---|---|---|---|---|
Some characters appear as junk values after bulk load. | The Snaplex uses character sets defined in the OS on which they are installed. Due to this, any unrecognized character set is not supported by the Snaplex as well. As a result, such characters in the data set are represented as junk values in the database after a bulk load operation. | This problem can be resolved by editing the bcp.bat file to accept custom characters. And using the absolute path to this bcp file in the BCP absolute path property. The bcp.bat file must contain the following:
|
...