Creating your Data Integration in FDL

In this article

Overview

You can use SnapLogic Fast Data Loader (FDL) to load your data from the available data source endpoints to the cloud data warehouses. Start by creating your own integration using the endpoints.

Accessing FDL

  1. Log in to the Intelligent Integration Platform (IIP) with your SnapLogic credentials.

  2. Click the tic-tac-toe icon at the top left of the page.

If you have access to FDL, the Fast Data Loader integration workflow page is displayed. Else, you can get access by using the FDL registration page.

Note: If you have existing integrations you will be directed to the FDL Dashboard. You can click New Integration to configure a new integration.

Creating a Data Integration

An enterprise ecosystem includes data from many sources such as sales management systems and service management systems. You have multiple options for implementing integrations between these systems. Configuring your data integration is a three-step process:

  1. Choose and Connect Your Source

  2. Choose and Connect Your Destination

  3. Set up and Verify

FDL integration workflow

Note: Ensure that you have access to the source and destination accounts before initiating the integration process.

  1. In Choose and Connect your source section, select the source from which you want to load your data.
    Note: You can change your source by clicking Change at the top of the section.

    1. Choose your credentials by clicking one of the following:

      • Click Use existing credentials if you want to use configured credentials to set up your source and choose the connection from the Select existing connection dropdown list.

      • Click Configure new credentials if you want to create new credentials to set up your source.

        1. Enter the required values in the fields. You can see the details of the settings on the configuration page of each endpoint.

        2. Click Validate and Save.

           

  2. In Choose and Connect your destination section, select the destination to which you want to load your data.

    1. Choose your credentials by clicking one of the following:

      • Click Use existing credentials if you want to use configured credentials to set up your destination and choose the connection from the Select existing connection dropdown list.

      • Click Configure new credentials if you want to create new credentials to set up your destination.

        1. Enter the required values in the fields. You can see the details of the settings on the configuration page of each endpoint.

        2. Click Validate and Save.

           

  3. Set up and Verify your integration.

    1. Choose one of the following integration methods:

      • Reload: To reload the data.

      • Upsert: To upsert the data, which inserts new records and updates existing records. FDL creates a table if a table does not exist, and then loads the data.

      • SCD2: To load historical data using the Slowly Changing Dimension Type 2 (SCD2) table.

    2. In Concurrency, select a value to indicate the number of users who can access data at the same time.

    3. From the Table to integrate the drop-down list, select the table into which you want to integrate the data.

     

  4. In Name your integration, enter a unique name of your integration.

  5. Select one of the following options:

    • Click Save to save your integration.

    • Click Save and Load to save and load your integration to the cloud data warehouse.

Your integration is configured successfully with the selected endpoints. The completed integration is displayed in the FDL Dashboard.

  • FDL Dashboard displays once you complete your first integration. Thereafter, you can create your integration by clicking the New Integration icon on the FDL Dashboard.

  • You can set the frequency of your integration to automatically run at scheduled intervals to load new data. For more information, see Setting up an Integration Schedule.

Available Endpoints in Fast Data Loader

Click the endpoint of your choice to know the configuration process.

Source endpoint

Supported versions of the endpoint

Source endpoint

Supported versions of the endpoint

Salesforce

Salesforce Service version 20.0 to 43.0. 

ServiceNow

Orlando, New York, and Madrid

Oracle

Oracle 11i JDBC driver

Coupa

Coupa API R25 version

SQL Server

SQL Server 2008 to 2016

Weather (Preconfigured Source endpoints)

N/A

Covid (Preconfigured Source endpoints)

N/A

Destination endpoint

Supported versions of the endpoint

Redshift

Redshift version 8

SAP DWC

SAP ERP 6.0

Snowflake

Snowflake JDBC jar version 3.12.3

Contact FDL customer support at fdl-support@snaplogic.com for assistance.

What to do next: Select your source endpoint from the above list.


See Also

https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/1942159838

https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/2004029460

https://docs-snaplogic.atlassian.net/wiki/spaces/SD/pages/2006486058