Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Table of Contents
minLevel1
maxLevel2
absoluteUrltrue

Understanding the Solution

This Use Case example Pipeline demonstrates how to read data from Snowflake database and ingest that data in bulk into the Azure Synapse database.

...

Download the Azure Synapse SQL Pipeline.

Prerequisites: A valid Azure Synapse SQL Account.

Configure the Azure Synapse SQL Account

Configure the Azure Synapse SQL Account as follows:

...

Reading Data from Snowflake

Configure the Snowflake Select Snap to read and select the data from INVOICEDATA table in the Snowflake database.

...

On validating, the Snap selects the data and displays the following output:

...

Ingesting Data into Azure Synapse

Configure the Azure Synapse SQL - Bulk Load Snap to load the data from the upstream Snap and ingest into the "dbo"."PerfHugeDataTest" table in Azure Synapse.

...

The data is written to a temporary file in the Snaplex and then uploaded to the Azure storage using the Azure API. After uploading the files to the Azure storage folder, the Snap runs the COPY INTO command to load the data from the files to the table.

Downloads

Attachments
patterns*.slp, *.zip

...