A new version of AutoSync is available in Studio! Check out the documentation.
Each AutoSync integration handles the synchronization of data from one source to one CDW. You can enter connection parameters or select from saved configurations, which enables SnapLogic Org admins to share endpoint accounts without disclosing the credentials. Learn more about configuring connections.
You can save a new or modified integration to run later, or have it start loading immediately. With an immediate load, AutoSync schedules subsequent synchronizations every 6 hours, which is customizable. Learn more about scheduling synchronization.
On the initial load, if the destination does not contain a table with the same name as a source table, AutoSync creates it. If a source table contains foreign keys, AutoSync loads the referenced data into the destination table, effectively flattening the data model.
Create an Integration
If AutoSync is enabled in your SnapLogic Org, you can create an integration even if you don’t have a supported data source or CDW. We provide two sample source data sets and for a CDW, you can request a free trial from one of the supported providers. This example describes how to use one of the preconfigured data sets to create a new integration. Have your credentials ready and follow these steps to create an integration:
Log in to the Intelligent Integration Platform (IIP) with your SnapLogic credentials.
Click the arrow on the Designer tab and select AutoSync V1.0:
If you have existing integrations, the dashboard opens:
If no integrations exist, the dialog for creating an integration opens:
Select a Source and Destination
Start defining the integration:
Click Covid or Weather:
Select the destination CDW:
The following shows the screen after selecting Snowflake:
To enter connection information click New configuration.
Enter a name for the configuration.
For Account Properties, enter the information necessary to connect to the destination. Required fields are marked with an asterisk.
Click Validate and Save.
After validation succeeds, select the target schema from the dropdown list. Step 3 opens:
Set Up Synchronization
Choose how to synchronize and where to replicate the data:
Choose one of the following synchronization types. Not all options are available for every source-destination pair, the Supported Load Methods table lists all combinations.
Load and reload (overwrite): Loads the first time and on reload, overwrites the tables.
Insert new and update changed: Upserts on reload.
Maintain change history using SCD2: Creates a Slowly Changing Dimension Type 2 (SCD2) table in the destination to track change history.
For Concurrency, select the number of tables for AutoSync to synchronize simultaneously.
Select one or more source tables to load and synchronize in the destination. For example, in the preconfigured weather dataset, you can select from the following:
Leave the box selected so that a new integration is not started when one is already in process.
The default integration name includes your initials, the source, the destination, and a number that increments each time you create a new integration. Change the name if you prefer.
Save your integration by clicking one of the following: Save:Saves the integration for future scheduling. Save and load:Saves your integration, starts loading the data after 10 seconds, and sets a default schedule for every 6 hours. AutoSync creates a table if it does not exist, and then loads the data. The dashboard opens. A card displays information about the integration. The following screenshot shows the results of saving without loading:
The Status indicates that the integration has not been executed.
After the first load, log in to your CDW to verify that the data loaded as expected.
Congratulations, you created your first AutoSync integration!