Key New Features

AutoPrep

• Split a column into multiple columns based on a delimiter.

• Use a custom name for the AutoPrep Snap.

• Choose the format of fields that contain currency, phone numbers, or country codes.
  
  

AutoSync

• In an integration, you can use the connection configuration from Accounts created in the IIP.

• Schedule replication for a custom time period.
  
  

API Management

Support for soft delete of an API, its Versions, and Version Assets.

Platform

• New Public APIs are added for managing app access and for importing projects.

• Secrets Management:

  • HashiCorp Vault users can use an alternate name for the approle.

  • HashiCorp Vault users can constrain the use of secrets by the Project Space.

• Create a GitHub tag in Manager.
  
  

Snaps

• Snap Packs with new Snaps:

  • Amazon S3

  • Azure Synapse SQL

  • Marketo

Studio Patterns

This release introduces 42 new Patterns.

Dot Releases

Platform

Snaps

Upgrade to this Release

November UAT Delta

AutoPrep

New Features

• You might want to add multiple AutoPrep Snaps to a Pipeline. You can rename an AutoPrep Snap to distinguish between them. To rename the AutoPrep Snap:

  • Open AutoPrep.

  • Click the name.

  • Enter the new name.

    Open

    

    
    
    

• New transformations available from the field options menu in the Data preview pane include:

  • Split a text or numeric field into multiple columns, based on a delimiter:

    Open

    

  • Choose the format of fields containing currency, phone numbers, and country codes:

Refer to Transforming Data with AutoPrep to learn more about these new features.

Enhancements

• Column names are case-insensitive. If you name two columns the same, but use different casing, AutoPrep displays an alert, but allows the change.

AutoSync

New Features

When creating or editing integrations, you can now select from the following saved connection configurations:

• Connection configurations that you created in AutoSync.

• Accounts that you or an Org admin created in the IIP that are saved in:

  • The global shared folder

  • The shared folder, in the ~SL-AutoSyncProjectSpace

  • Your AutoSync project, ~User~<username>_<snaplogic_org>, in the SL-AutoSync-ProjectSpace

Refer to Configuring Source and Destination Connections to learn more.

Enhancements

• New load options are available for some sources. Refer to Supported Load Methods for the complete list.

• Added the Role field to the connection configuration for the Snowflake data destination. Specify the role you have in the target database.

• When scheduling replication, you can choose a custom frequency between one minute and 24 hours:

• You can use the Upsert load method for integrations using a Coupa source and an Amazon Redshift destination.

Known Limitations

• Integrations from Salesforce to Redshift that use the SCD2 load type encounter an error when loading.

• Integrations from ServiceNow to Redshift that use the SCD2 load type encounter an error when loading.

• Connection configuration in AutoSync for Coupa requires an API key, which was deprecated by Coupa in May of 2022, in Release 29. You can still use valid API keys created before Release 29.

• For integrations that use JSON files from an Amazon S3 bucket: AutoSync uses the first element in a JSON file to define the number of columns to create in the destination. All elements of the JSON file must have the same number of key-value pairs or AutoSync cannot load the data.

API Management

New Features

• Remove Version Assets from API Manager easily and send them to the Recycle Bin in Manager. A soft delete provides a safeguard so you can declutter API folders without inadvertently deleting an endpoint. Previously, only a permanent delete from the entire platform was supported for Version Assets.

Enhancements

• The Snap Pack option no longer appears in a Version Asset. This removal is part of a broader effort to optimize space in the UI. In APIM, you can use the global shared folder of your Org as the repository of shared Snap Packs and other referenced Assets.

Fixed Issues

• The help hook question mark on the OAuth2 Client Credential API Policy dialog now opens the correct documentation page.

• An error message now results when selecting to publish an API from a local file on the Publish API dialog and publishing it without actually uploading the file. Previously, the operation resulted in the display of a blank API Manager page.

• The Top Consumer by Request widget on the API Dashboard displays the values for the Y-axis.

Data Automation

Enhancements

• As shown in the figure, the ELT Insert-Select, ELT Merge Into, and ELT SCD2 Snaps show the following statistics on execution:

  • Records Added

  • Records Updated

  • Records Deleted

   

Known Issues

• If the last Snap in the Pipeline takes 2 to 5 seconds to update the runtime, the ELT Pipeline statistics are not displayed even after the Pipeline is completed. The UI does not autorefresh to display the statistics after the runtime.

  Workaround: Close the Pipeline statistics window and reopen it to see the ELT Pipeline statistics.

• In the ELT Merge Into Snap, the Records Updated parameter in the Snap Statistics tab (on Pipeline execution) displays the combined count of records that were inserted, updated, and deleted.

• When you return to the Snap Statistics tab from the Extra Details tab in the Pipeline Execution Statistics pane, it contains the status bar (Pipeline execution status) instead of the Download Query Details hyperlink and the individual counts of Records Added, Records Updated, and Records Deleted.

Platform

New Features

• New Public APIs allow you to do the following:

  • Retrieve App Access Info

  • Grant or Revoke App Access

  • Import a Project

Enhancements

• SnapLogic security is enhanced with the recommended OWASP security headers added to responses from a Groundplex:

  • Strict-Transport-Security

  • X-XSS-Protection

  • X-Frame-Options

  • X-Content-Type-Options

  • Content-Security-Policy

  • Referrer-Policy

• The SnapLogic Docker image is updated based on AlmaLinux, instead of CentOS.

• Git Integration enhancements include:

  • The IIP supports creating a GitHub tag. When a branch is checked out for a Project, the Project options menu includes the GitHub Add Tag:

  • When you check out a Pipeline and commit it without any changes, the order of the Snaps is preserved in the underlying JSON serialization files. This was not the case previously, which caused Pipelines in the GitHub repository to sometimes appear as if they had been updated when they had not.

• On the SnapLogic Dashboard, Pipeline duration is now the completion time minus the Pipeline’s start time.

• Secrets Management enhancements include:

  • To constrain use of secrets by project space, add a project_space property in your secrets-config.json configuration file. Provide the path to the Project Space that contains the secrets. For example, "project_space" : "/snaplogic/shared" constrains users to secrets stored in Accounts in the snaplogic Project Space shared folder. Refer to Configuring Snaplex Nodes for more information.

  • Previously, the SnapLogic secrets-config.json file only supported the approle authentication path. Now, you can use a custom path by adding an auth_path to the secrets-config.json configuration file. For example, the addition of "auth_path": "demo" enables the demo authentication path. Refer to Configuring Snaplex Nodes for more information.

• Improved load balancing for child Pipeline executions by removing the requirement to use the same node as the parent Pipeline and by selecting the best node based on the memory used.

Deprecated

• The Local Dashboard standalone UI for Groundplexes has been deprecated.

Snaps

Upcoming

New Snaps

Amazon S3 Snap Pack

Introduced the following Snaps:

• S3 Archive: Enables you to archive or change the storage class of an S3 object.

• S3 Restore: Enables you to restore an archived S3 object.

• S3 Select: Enables you to retrieve a subset of data from an S3 object.

Azure Synapse SQL Snap Pack

Azure Synapse SQL is an analytics service from Microsoft that enables querying data to create, delete, execute, insert, list, load, select, store, and update data in the Azure Synapse SQL. This Snap Pack offers the following Snaps:

• Azure Synapse SQL Bulk Load: Enables you to perform a bulk load operation from an external location to the target table.

• Azure Synapse SQL Delete: Enables you to delete records from the target tables.

• Azure Synapse SQL Execute: Enables you to execute SQL queries.

• Azure Synapse SQL Insert: Enables you to insert new records into the target tables.

• Azure Synapse SQL Select: Enables you to fetch data from an Azure Synapse SQL Server database.

• Azure Synapse SQL Stored Procedure: Enables you to execute stored procedures in the Azure Synapse SQL database.

• Azure Synapse SQL Table List: Enables you to read data from Azure Synapse SQL and list the tables.

• Azure Synapse SQL Update: Enables you to update existing records in the target tables with the specified conditions.

Marketo Snap Pack

Introduced the following Snaps to manage bulk extract and import in Marketo:

• Bulk Extract: Enables you to extract the specific entity from Marketo.

• Bulk Import: Enables you to import the specific entity from Marketo.

Enhancements

• The Azure Active Directory List Users, Azure Active Directory Get Group Members, and Azure Active Directory Get Role Members Snaps now include the Display Properties field, which allows you to enter the properties that you want to view in the output.

• The AWS S3 and S3 Dynamic accounts now support a maximum session duration of an IAM role defined in AWS.

• The Azure SQL Snap Pack now uses the 11.2x driver by default. If you specify any specific driver, ensure that you provide a version higher than 9.1 that is compatible with Microsoft Authentication Library for Java because this Snap Pack uses the MSAL4J; otherwise, you might have issues.

• Exchange Online

  • The Exchange Online OAuth2 User Account now does not encounter an Access Denied (403) error. Now only the current user details are fetched when you do not have User.Read.All permission.

  • Exchange Online Read Email:

    • This Snap now shows the email folder suggestions and includes the subfolders' names successfully by prefixing the parent folder name with the / delimiter.

    • This Snap now downloads the inline attachments correctly when you select the Download attachments checkbox. The Snap now shows the email folder suggestions and includes the subfolder names by prefixing the parent folder name with the delimiter (/). For example, custom/subfolder.

  • The Send Email Snap supports sending the HTML Table in the email body using the following fields:

    • HTML Table option under Email type

    • Table Data Path

    • Batch Size

• Eloqua

  • The Eloqua Snaps now include the Pass through checkbox, which enables the Snap to pass the input document to the output view under the key original.

  • The Custom Object Metadata ID field in the Eloqua Create Snap allows you to specify an ID for creating custom object data. This conditional field appears only when you select Custom Object Data as the Core object type.

• The Excel Formatter and Excel Multi Sheet Formatter Snaps now include a Convert formula strings to formulas checkbox.

• The HTTP Client Snap now accepts the default value */* for the Accept header, which communicates to the server that the Snap can handle all forms of response content types.

• The Mapper Snap now has a Sorted checkbox in the Input Schema and Target Schema panels, which allows you to sort the input and target schemas. When unchecked, the Snap unsorts the input and the target schema.

• Marketo

  • The Asset Write Snap now supports special characters.

  • The Asset Read, Asset Write, Lead Read, and Lead Write Snaps now have a new field set, Query Parameters, which enables you to define additional parameters for retrieving the asset details.

• The PostgreSQL - Bulk Load Snap can now process the records with more than 16 KB in the document without encountering the BufferOverflowException because the default value of 16 KB for byte buffer size is now removed.

• The S3 Browser Snap output now includes the Storage Class field, which indicates the archived status of the S3 object.

• The Snowflake - Bulk Load Snap now routes the 403-Access Denied error to the error view (when the error view is enabled) when you do not have DeleteObject permission to delete the temporary files in the S3 bucket.

• The Salesforce Bulk Query Snap now includes the following checkboxes:

  • Match Data Type: Select this checkbox to match the data types of the bulk query job results. On selecting this checkbox, the Object Type field appears that enables you to enter the object type for matching the data type.

  • Include Deleted Records: Select this checkbox to include deleted records in the query result.

• The SQL Server - Select Snap now has the Convert rowversion datatype to integer checkbox to support the ROWVERSION datatype. Select this checkbox to display the Rowversion datatype as integers in the output.

Behavior change

In the 4.31 main18944 release and later, the Snowflake - Bulk Upsert Snap no longer supports values from an upstream input document in the Key columns field when the expression button is enabled.
To avoid breaking your existing Pipelines that use a value from the input schema in the Key columns field, update the Snap settings to use an input value from Pipeline parameters instead.

Fixed Issues

• Fixed the following issues in the Snowflake - Bulk Load Snap:

  • The Snap failed when the Preserve case sensitivity field was not selected and the column names in the input document and the target table were the same but the cases were different. Now, the Snap does not fail and loads the data correctly to the target table.

  • The Snap created a table when it did not exist with multiple columns in the target table when there were two input views, but the column name cases were different in both views. Now, the Snap creates the table from the metadata provided by the second input view and loads the data into the target table from the first input view.

• The Generic JDBC - Insert Snap previously took a long time to execute and was aborted after a few minutes, which affected the performance of the Snap. Now the Snap takes less time for execution.

• MySQL Insert, Oracle Insert, PostgreSQL Insert, Redshift Insert, Snowflake Insert, SQL Server - Insert, Databricks - Insert, Google AlloyDB Insert, SAP HANA Insert, TPT Insert, and Vertica - Insert: The above-mentioned Database Insert Snaps now create the target table only from the table metadata of the second input view when the following conditions are met:

  • The Create table if not present checkbox is selected.

  • The target table does not exist.

  • The table metadata is provided in the second input view.

• The S3 Download Snap no longer fails even when the Pipeline has multiple Snaps after 430patches18348.

• The following Snaps now handle lineage properly when used in an Ultra Pipeline: NetSuite Get Item Availability, NetSuite Delete, and NetSuite GetList.

Known Issues

• Marketo Snaps do not support some special characters (for example, (𝖖𝖗𝖘𝖬𝖭𝖮𝗕𝗖𝘧𝘨𝘩𝛀𝛁𝛂𝛃𝛄𝛅𝛆𝛇,𝖗𝖘𝖬𝛌𝛗𝛘𝛙𝛴).

• Snowflake Snap Pack: Because of performance issues, all Snaps now ignore the Cancel queued queries when pipeline is stopped or if it fails option for Manage Queued Queries, even when selected. Snaps behave as though the default Continue to execute queued queries when the Pipeline is stopped or if it fails option were selected.

  
  We plan to address this Snowflake issue in a patch for the December release.

Studio (Preview)

Enhancements

• In the Execution Overview and Pipeline details, Pipeline duration is now the completion time minus the Pipeline’s start time.

Studio Patterns

New Features

The following Patterns were added to the Studio Patterns Catalog.

• Automate Customer Onboarding

• Bulk Delete Salesforce Contacts in CSV Files

• Create Record in Google Sheets for Lead Added or Updated in Marketo

• Create SnapLogic Groups and Populate Them with Lists of Users

• Data Validator and De-Duplication

• Dynamic Data Pivot

• Employee Journey: People Analytics

• Employee Journey: Recruiting

• Errors to Slack and Email

• Fetch Candidate Data from Taleo using REST API

• Get Check Object Data from NetSuite and Load Them into Redshift

• Get Leads from Marketo and Write Them to a CSV File

• Get Metrics and Resource utilization on current Snaplexes

• Get Product Details from Oracle, SAP, and Salsify

• Ingest Data from File Server into AWS Cloud Storage

• Ingest Data from Salesforce into AWS Cloud Storage

• Insert New Employee Data into Workday

• Load Data from Google Storage into Google BigQuery using Avro File Format

• Load Multiple Small Files and Their Metadata into Target Such as S3, ADL, HDFS

• Load Salesforce contacts into Microsoft Azure Storage (WASB)

• Loading Data From Multiple CSV Files Into Two Oracle Tables

• Move Data from AWS S3 to Snowflake Data Warehouse

• Move Data from a Relational Database Into Teradata

• NetSuite Contact to ServiceNow User

• Oracle to Salesforce

• Replicate Data from Salesforce to Multiple Databases

• SAP to Dynamics

• Salesforce to Microsoft Azure Data Lake Storage

• Salesforce to Microsoft Dynamics 365 Finance and Operations

• Salesforce to Tableau

• Schema Bulk Load from SQL Server to Snowflake

• Search Issues in Jira and Send Them in an Email Message

• Send a File to Salesforce as an Attachment

• ServiceNow to Microsoft Dynamics 365

• SnapLogic Public APIs to Read and Write the Runtime Execution Information

• SnapLogic Before and After Control-Break Pipeline

• Sync Amazon S3 Files by Inserting Records to Redshift Table

• Sync Data from Workday to Anaplan

• Sync New Customer between NetSuite and Marketo

• Update Employee Data from Oracle to Workday

• Workday to Jira

• Workday to Oracle and BambooHR

Documentation Enhancements

• Enhanced Encryption: Page updated, reorganized, and edited for clarity

• SnapLogic AutoSync: Section reorganized and edited for usability

• Git Integration Reference: Screenshots updated and edited for usability

• Performing Git Operations: Screenshots updated and edited for usability

• Use Patterns in SnapLogic Studio video shows how to download and open a Pipeline Pattern from Studio

• Set Canned ACLs video provides a conceptual overview of the new AWS canned ACL property

• Configure File Writer to Write to S3 Bucket video describes how to configure the File Writer Snap to write to the S3 Bucket

• Obtain WebHook URL to Configure Google Sheets Subscribe Snap video walks through the steps to configure the Google Sheets Subscribe Snap

• My First Pipeline video demonstrates the process of creating a pipeline for a first-time user in the redesigned IIP