Key New Features

AutoPrep

• Split a column into multiple columns based on a delimiter.

• Use a custom name for the AutoPrep Snap.

• Choose the format of fields that contain currency, phone numbers, or country codes.
  
  

AutoSync

• In an integration, you can use connection configuration from Accounts created in the IIP.

• Schedule replication for a custom time period.
  
  

API Management

Support for soft delete of an API, its Versions, and Version Assets.

Platform

• New Public APIs are added for managing app access and for importing projects.

• Secrets Management:

  • HashiCorp Vault users can use an alternate name for the approle.

  • HashiCorp Vault users can constrain use of secrets by Project Space.

• Create a GitHub tag in Manager.
  
  

Snaps

• Amazon S3 Archive, Restore, and Select

• Azure Synapse SQL

• Marketo Bulk Import and Extract

Studio Patterns

42 new Patterns!

Upgrade to this Release

November UAT Delta

AutoPrep

New Features

• You might want to add multiple AutoPrep Snaps to a Pipeline. You can rename an AutoPrep Snap to distinguish between them. Rename the AutoPrep Snap by:

  • Open AutoPrep.

  • Click the name.

  • Enter the new name.
    
    

    Open

    

    
    
    

• New transformations available from the field options menu in the Data preview pane include:

  • Split a text or numeric field into multiple columns, based on a delimiter:

    Open

    

  • Choose the format of fields containing currency, phone numbers, and country codes:

Enhancements

• Column names are case-insensitive. If you name two columns the same, but use different casing, AutoPrep displays an alert, but allows the change.

AutoSync

New Features

When creating or editing integrations, you can now select from the following saved connection configurations:

• Connection configurations that you created in AutoSync.

• Accounts that you or an Org admin created in the IIP that are saved in:

  • The global shared folder

  • The shared folder, in the ~SL-AutoSyncProjectSpace

  • Your AutoSync project, ~User~<username>_<snaplogic_org>, in the SL-AutoSync-ProjectSpace

Enhancements

• New load options are available for some sources. Refer to Supported Load Methods for the complete list.

• Added the Role field to the connection configuration for the Snowflake data destination. Specify the role you have in the target database.

• When scheduling replication, you can choose a custom frequency between one minute and 24 hours:

• You can use the Upsert load method for integrations using a Coupa source and an Amazon Redshift destination.

API Management

New Features

• Remove Version Assets from API Manager easily and send them to the Recycle Bin in Manager. A soft delete provides a safeguard so you can declutter API folders without inadvertently deleting an endpoint. Previously, only a permanent delete from the entire platform was supported for Version Assets.

Enhancements

• The Snap Pack option no longer appears in a Version Asset. This removal is part of a broader effort to optimize space in the UI. In APIM, you can use the global shared folder of your Org as the repository of shared Snap Packs and other referenced Assets.

Fixed Issues

• The help hook question mark on the OAuth2 Client Credential API Policy dialog now opens the correct documentation page.

• An error message now results when selecting to publish an API from a local file on the Publish API dialog and publishing it without actually uploading the file. Previously, the operation resulted in the display of a blank API manager page.

• The Top Consumer by Request widget on the API Dashboard displays the values for the Y-axis.

Data Automation

Enhancements

• ELT Insert-Select, ELT Merge Into, and ELT SCD2 Snaps show the following statistics on execution as illustrated in the figure below:

  • Records Added

  • Records Updated

  • Records Deleted

   

Known Issues

• If the last Snap in the Pipeline takes 2 to 5 seconds to update the runtime, the ELT Pipeline statistics are not displayed even after the Pipeline is completed. The UI does not autorefresh to display the statistics after the runtime.

  Workaround: Close the Pipeline statistics window and reopen it to see the ELT Pipeline statistics.

Platform

New Features

• New Public APIs allow you to do the following:

  • Retrieve App Access Info

  • Grant or Revoke App Access

  • Import a Project

Enhancements

• SnapLogic security is enhanced with the recommended OWASP security headers added to responses from a Groundplex:

  • Strict-Transport-Security

  • X-XSS-Protection

  • X-Frame-Options

  • X-Content-Type-Options

  • Content-Security-Policy

  • Referrer-Policy

• The SnapLogic Docker image is updated based on AlmaLinux, instead of CentOS.

• Git Integration enhancements include:

  • The IIP supports creating a GitHub tag. When a branch is checked out for a Project, the Project options menu includes the GitHub Add Tag:

  • When you checkout a Pipeline and commit it without any changes, the order of the Snaps is preserved in the underlying JSON serialization files. This was not the case previously, which caused Pipelines in the GitHub repository to sometimes appear as if they had been updated when they had not.

• On the SnapLogic Dashboard, Pipeline duration is now the completion time minus the Pipeline’s start time.

• Secrets Management enhancements include:

  • To constrain use of secrets by project space, add a project_space property in your secrets-config.json configuration file. Provide the path to the Project Space that contains the secrets. For example, "project_space" : "/snaplogic/shared" constrains users to secrets stored in Accounts in the snaplogic Project Space shared folder.

  • Previously, the SnapLogic secrets-config.json file only supported the approle authentication path. Now, you can use a custom path by adding an auth_path to the secrets-config.json configuration file. For example, the addition of "auth_path": "demo" enables the demo authentication path.

Deprecated

• The Local Dashboard standalone UI for Groundplexes has been deprecated. This addresses a security vulnerability.

Snaps

New Snaps

Azure Synapse SQL Snap Pack

Azure Synapse SQL is an analytics service from Microsoft that enables querying data to create, update, insert, or delete data in the Azure Synapse SQL. This Snap Pack offers the following Snaps:

• Azure Synapse SQL Bulk Load: Enables you to perform a bulk load operation from an external location to the target table.

• Azure Synapse SQL Delete: Enables you to delete records from the target tables.

• Azure Synapse SQL Execute: Enables you to execute SQL queries.

• Azure Synapse SQL Insert: Enables you to insert new records into the target tables.

• Azure Synapse SQL Select: Enables you to fetch data from an Azure Synapse SQL Server database.

• Azure Synapse SQL Stored Procedure: Enables you to execute stored procedures in the Azure Synapse SQL database.

• Azure Synapse SQL Table List: Enables you to read data from Azure Synapse SQL and list the tables.

• Azure Synapse SQL Update: Enables you to update existing records in the target tables with the specified conditions.

Marketo Snap Pack

Introduced the following Snaps to manage bulk export and import in Marketo:

• Bulk Extract: Enables you to extract the specific entity from Marketo.

• Bulk Import: Enables you to import the specific entity from Marketo.

Amazon S3 Snap Pack

Introduced the following Snaps:

• S3 Archive: Enables you to archive or change the storage class of an S3 object.

• S3 Restore: Enables you to restore an archived S3 object.

• S3 Select: Enables you to retrieve a subset of data from an S3 object.

Enhancements

• The Azure Active Directory List Users, Azure Active Directory Get Group Members, and Azure Active Directory Get Role Members Snaps now has the new Display Properties field that allows you to enter the properties that you want to view in the output.

• The AWS S3 and S3 Dynamic accounts now support maximum session duration of an IAM role defined in AWS.

• The Azure SQL Snap Pack now uses the 11.2x driver by default. If you specify any specific driver, ensure that you provide a version higher than 9.1 that is compatible with Microsoft Authentication Library for Java, as this Snap Pack uses the MSAL4J; otherwise, you may run into issues.

• Exchange Online

  • The Exchange Online OAuth2 User Account now does not encounter Access Denied (403) error. Now only the current user details are fetched when you do not have User.Read.All permission in your permissions scope.

  • The Exchange Online OAuth2 User Account now does not encounter Access Denied (403) error. Now only the current user details are fetched when you do not have a User.Read.All permission in your permissions scope.

  • The Exchange Online Read Email Snap now shows the email folder suggestions and includes the subfolders' names successfully by prefixing the parent folder name with the '/' delimiter.

  • The Exchange Online Read Email Snap now downloads the inline attachments correctly when you select the Download attachments checkbox. The Snap now shows the email folder suggestions and includes the subfolder names by prefixing the parent folder name with the delimiter ('/'). For example, custom/subfolder.

  • The Send Email Snap supports sending the HTML Table in the email body using the following fields:

    • HTML Table option under Email type

    • Table Data Path

    • Batch Size

• Eloqua

  • The Eloqua Snaps now include the Pass through checkbox, which enables the Snap to pass the input document to the output view under the key original.

  • The Custom Object Metadata ID field in the Eloqua Create Snap allows you to specify an ID for creating custom object data. This conditional field appears only when you select Custom Object Data as the Core object type.

• The Excel Formatter and Excel Multi Sheet Formatter Snaps now include a Convert formula strings to formulas checkbox.

• The HTTP Client Snap now accepts the default value */* for the Accept header, which communicates to the server that the Snap can handle all forms of response content types.

• The Mapper Snap now has a Sorted checkbox in the Input Schema and Target Schema panels, which allows you to sort the input and target schemas. When unchecked, the Snap unsorts the input and the target schema.

• Marketo

  • The Asset Write Snap now supports special characters.

  • The Asset Read, Asset Write, Lead Read, and Lead Write Snaps now have a new field set, Query Parameters, which enables you to define additional parameters for retrieving the asset details.

• The PostgreSQL - Bulk Load Snap can now process the records with more than 16 KB in the document without encountering the BufferOverflowException because the default value of 16 KB for byte buffer size is now removed.

• The S3 Browser Snap output now includes the Storage Class field, which indicates the archived status of the S3 object.

• The Snowflake - Bulk Load Snap now routes the 403-Access Denied error to the error view (when the error view is enabled) when you do not have DeleteObject permission to delete the temporary files in the S3 bucket.

• The Salesforce Bulk Query Snap now includes the following checkboxes:

  • Match Data Type: Select this checkbox to match the data types of the bulk query job results.

  • Object Type: This option appears on selecting the Match Data Type checkbox.

  • Include Deleted Records: Select this checkbox to include deleted records in the query result.

• The SQL Server - Select Snap now has the Convert rowversion datatype to integer checkbox to support the ROWVERSION datatype. Select this checkbox to display the Rowversion datatype as integers in the output.

Fixed Issues

• Fixed the following issues in the Snowflake - Bulk Load Snap:

  • The Snap failed when the Preserve case sensitivity field was not selected and the column names in the input document and the target table were the same but the cases were different. Now, the Snap does not fail and loads the data correctly to the target table.

  • The Snap created a table when it did not exist with multiple columns in the target table when there were two input views, but the column name cases were different in both views. Now, the Snap creates the table from the metadata provided by the second input view and loads the data into the target table from the first input view.

• The Generic JDBC - Insert Snap previously took a long time to execute and was aborted after a few minutes, which affected the performance of the Snap. Now the Snap takes less time for execution.

• MySQL Insert, Oracle Insert, PostgreSQL Insert, Redshift Insert, Snowflake Insert, and SQL Server - Insert: These Database Insert Snaps now create the target table only from the table metadata of the second input view when the following conditions are met:

  • The Create table if not present checkbox is selected.

  • The target table does not exist.

  • The table metadata is provided in the second input view.

• The S3 Download Snap no longer fails even when the Pipeline has multiple Snaps after 430patches18348.

Known Issues

• Marketo does not support some special characters (for example, (𝖖𝖗𝖘𝖬𝖭𝖮𝗕𝗖𝘧𝘨𝘩𝛀𝛁𝛂𝛃𝛄𝛅𝛆𝛇,𝖗𝖘𝖬𝛌𝛗𝛘𝛙𝛴).

Upcoming

The following changes are scheduled for release in 2023 February:

• MySQL Snap Pack: The default JAR file of the MySQL Database account does not support connectivity to MYSQL8. To connect to MYSQL8, you must upload a compatible mysql-connector (v.5.1.47 or v8) JAR. In the upcoming February Release, we will upgrade the default MySQL JAR bundled with the MySQL Snap to the latest version that is backward compatible and able to connect to MySQL 8. Learn more about version compatibility in this MySQL article.

Studio (Preview)

Enhancements

• In the Execution Overview, Pipeline duration is now the completion time minus the Pipeline’s start time.

Studio Patterns

New Features

The following Patterns were added to the Studio Patterns Catalog.

• Automate Customer Onboarding

• Bulk Delete Salesforce Contacts in CSV Files

• Create Record in Google Sheets for Lead Added or Updated in Marketo

• Create SnapLogic Groups and Populate Them with Lists of Users

• Data Validator and De-Duplication

• Dynamic Data Pivot

• Employee Journey: People Analytics

• Employee Journey: Recruiting

• Errors to Slack and Email

• Fetch Candidate Data from Taleo using REST API

• Get Check Object Data from NetSuite and Load Them into Redshift

• Get Leads from Marketo and Write Them to a CSV File

• Get Metrics and Resource utilization on current Snaplexes

• Get Product Details from Oracle, SAP, and Salsify

• Ingest Data from File Server into AWS Cloud Storage

• Ingest Data from Salesforce into AWS Cloud Storage

• Insert New Employee Data into Workday

• Load Data from Google Storage into Google BigQuery using Avro File Format

• Load Multiple Small Files and Their Metadata into Target Such as S3, ADL, HDFS

• Load Salesforce contacts into Microsoft Azure Storage (WASB)

• Loading Data From Multiple CSV Files Into Two Oracle Tables

• Move Data from AWS S3 to Snowflake Data Warehouse

• Move Data from a Relational Database Into Teradata

• NetSuite Contact to ServiceNow User

• Oracle to Salesforce

• Replicate Data from Salesforce to Multiple Databases

• SAP to Dynamics

• Salesforce to Microsoft Azure Data Lake Storage

• Salesforce to Microsoft Dynamics 365 Finance and Operations

• Salesforce to Tableau

• Schema Bulk Load from SQL Server to Snowflake

• Search Issues in Jira and Send Them in an Email Message

• Send a File to Salesforce as an Attachment

• ServiceNow to Microsoft Dynamics 365

• SnapLogic Public APIs to Read and Write the Runtime Execution Information

• SnapLogic Before and After Control-Break Pipeline

• Sync Amazon S3 Files by Inserting Records to Redshift Table

• Sync Data from Workday to Anaplan

• Sync New Customer between NetSuite and Marketo

• Update Employee Data from Oracle to Workday

• Workday to Jira

• Workday to Oracle and BambooHR