...
The following aspects come into play when you are manually moving move the data between the two databases:
...
Using the Snowflake Snap Pack, you can automate the process transferring the data from PostgreSQL to Snowflake. This pipeline below covers almost every challenge mentioned above that you might encounter when transferring the data manually.
...
Download this solution.
Understanding the Solution
In the initial phase, the pipeline truncates any pre-existing table in the Snowflake environment to prevent the creation of multiple tables. Subsequently, a specific table is chosen from the PostgreSQL database for data transfer, and this information is stored in distinct variables through the utilization of the Mapper Snap. The data is then deposited into a newly created table in the Snowflake environment. To ensure the accuracy of the data transfer, the transferred data is retrieved from the Snowflake table for validation.
Steps
Step 1: Configure the Snowflake-Execute Snap with the truncate query to delete the Snowflake table if exists.
...
Step 2: Configure the PostgreSQL-Select Snap with the required table from where you want to transfer data.
...
Step 3: Configure the fields in the Mapper Snap as follows. On validation, the Mapper displays all the data that must be transferred.
 |  |
Step 4: Insert the data extracted from PostgreSQL in the table created in Snowflake.
...
Step 5: Verify if the values have been successfully transferred using the Snowflake-Select Snap. On validation, the Snowflake-Execute Snaps displays all the data that has been transferred.
 |  |
Downloads
| Attachments | ||
|---|---|---|
|
...