Split a column into multiple columns based on a delimiter.
Use a custom name for the AutoPrep Snap.
Choose the format of fields that contain currency, phone numbers, or country codes.
In an integration, you can use connection configuration from Accounts created in the IIP.
Schedule replication for a custom time period.
Support for soft delete of an API, its Versions, and Version Assets.
New Public APIs are added for managing app access and for importing projects.
Secrets Management:
HashiCorp Vault users can use an alternate name for the approle.
HashiCorp Vault users can constrain use of secrets by Project Space.
Create a GitHub tag in Manager.
Amazon S3 Archive, Restore, and Select
Azure Synapse SQL
Marketo Bulk Import and Extract
42 new Patterns!
Important
|
This section tracks the changes made during the iterative pushes to the UAT server and the GA release. The following is the release schedule:
The SnapLogic GA release build on the production server is also deployed on the UAT server. The SnapLogic GA release build on the production server is also deployed on the UAT server. |
You might want to add multiple AutoPrep Snaps to a Pipeline. You can rename an AutoPrep Snap to distinguish between them. Rename the AutoPrep Snap by:
Open AutoPrep.
Click the name.
Enter the new name.
New transformations available from the field options menu in the Data preview pane include:
Split a text or numeric field into multiple columns, based on a delimiter:
Choose the format of fields containing currency, phone numbers, and country codes:
Column names are case-insensitive. If you name two columns the same, but use different casing, AutoPrep displays an alert, but allows the change.
When creating or editing integrations, you can now select from the following saved connection configurations:
Connection configurations that you created in AutoSync.
Accounts that you or an Org admin created in the IIP that are saved in:
The global shared folder
The shared folder, in the ~SL-AutoSyncProjectSpace
Your AutoSync project, ~User~<username>_<snaplogic_org>, in the SL-AutoSync-ProjectSpace
New load options are available for some sources. Refer to Supported Load Methods for the complete list.
Added the Role field to the connection configuration for the Snowflake data destination. Specify the role you have in the target database.
When scheduling replication, you can choose a custom frequency between one minute and 24 hours:
You can use the Upsert load method for integrations using a Coupa source and an Amazon Redshift destination.
Remove Version Assets from API Manager easily and send them to the Recycle Bin in Manager. A soft delete provides a safeguard so you can declutter API folders without inadvertently deleting an endpoint. Previously, only a permanent delete from the entire platform was supported for Version Assets.
The Snap Pack option no longer appears in a Version Asset. This removal is part of a broader effort to optimize space in the UI. In APIM, you can use the global shared folder of your Org as the repository of shared Snap Packs and other referenced Assets.
The help hook question mark on the OAuth2 Client Credential API Policy dialog now opens the correct documentation page.
An error message now results when selecting to publish an API from a local file on the Publish API dialog and publishing it without actually uploading the file. Previously, the operation resulted in the display of a blank API manager page.
The Top Consumer by Request widget on the API Dashboard displays the values for the Y-axis.
ELT Insert-Select, ELT Merge Into, and ELT SCD2 Snaps show the following statistics on execution as illustrated in the figure below:
Records Added
Records Updated
Records Deleted
Note: The statistics are also available in the output view of the child ELT Pipeline. |
If the last Snap in the Pipeline takes 2 to 5 seconds to update the runtime, the ELT Pipeline statistics are not displayed even after the Pipeline is completed. The UI does not autorefresh to display the statistics after the runtime.
Workaround: Close the Pipeline statistics window and reopen it to see the ELT Pipeline statistics.
New Public APIs allow you to do the following:
SnapLogic security is enhanced with the recommended OWASP security headers added to responses from a Groundplex:
Strict-Transport-Security
X-XSS-Protection
X-Frame-Options
X-Content-Type-Options
Content-Security-Policy
Referrer-Policy
The SnapLogic Docker image is updated based on AlmaLinux, instead of CentOS.
Git Integration enhancements include:
The IIP supports creating a GitHub tag. When a branch is checked out for a Project, the Project options menu includes the GitHub Add Tag:
When you checkout a Pipeline and commit it without any changes, the order of the Snaps is preserved in the underlying JSON serialization files. This was not the case previously, which caused Pipelines in the GitHub repository to sometimes appear as if they had been updated when they had not.
On the SnapLogic Dashboard, Pipeline duration is now the completion time minus the Pipelineโs start time.
Secrets Management enhancements include:
To constrain use of secrets by project space, add a project_space property in your secrets-config.json configuration file. Provide the path to the Project Space that contains the secrets. For example, "project_space" : "/snaplogic/shared" constrains users to secrets stored in Accounts in the snaplogic Project Space shared folder.
Previously, the SnapLogic secrets-config.json file only supported the approle authentication path. Now, you can use a custom path by adding an auth_path to the secrets-config.json configuration file. For example, the addition of "auth_path": "demo" enables the demo authentication path.
The Local Dashboard standalone UI for Groundplexes has been deprecated. This addresses a security vulnerability.
Read about the Snap features and fixes deployed in the October Dot Releases, which are part of the current GA version.
Read about the Snap features and fixes deployed in the October Dot Releases, which are part of the current GA version.
Azure Synapse SQL is an analytics service from Microsoft that enables querying data to create, update, insert, or delete data in the Azure Synapse SQL. This Snap Pack offers the following Snaps:
Azure Synapse SQL Bulk Load: Enables you to perform a bulk load operation from an external location to the target table.
Azure Synapse SQL Delete: Enables you to delete records from the target tables.
Azure Synapse SQL Execute: Enables you to execute SQL queries.
Azure Synapse SQL Insert: Enables you to insert new records into the target tables.
Azure Synapse SQL Select: Enables you to fetch data from an Azure Synapse SQL Server database.
Azure Synapse SQL Stored Procedure: Enables you to execute stored procedures in the Azure Synapse SQL database.
Azure Synapse SQL Table List: Enables you to read data from Azure Synapse SQL and list the tables.
Azure Synapse SQL Update: Enables you to update existing records in the target tables with the specified conditions.
The Azure Synapse SQL Snap Pack uses the 11.2x driver by default. If you specify any specific driver, ensure that you provide a version higher than 9.1 for compatibility with Microsoft Authentication Library for JAVA, as this Snap Pack uses the MSAL4J; otherwise, you may run into issues.
The Azure Synapse SQL Snap Pack uses the 11.2x driver by default. If you specify any specific driver, ensure that you provide a version higher than 9.1 for compatibility with Microsoft Authentication Library for JAVA, as this Snap Pack uses the MSAL4J; otherwise, you may run into issues.
Introduced the following Snaps to manage bulk export and import in Marketo:
Bulk Extract: Enables you to extract the specific entity from Marketo.
Bulk Import: Enables you to import the specific entity from Marketo.
Introduced the following Snaps:
S3 Archive: Enables you to archive or change the storage class of an S3 object.
S3 Restore: Enables you to restore an archived S3 object.
S3 Select: Enables you to retrieve a subset of data from an S3 object.
The Azure Active Directory List Users, Azure Active Directory Get Group Members, and Azure Active Directory Get Role Members Snaps now has the new Display Properties field that allows you to enter the properties that you want to view in the output.
The AWS S3 and S3 Dynamic accounts now support maximum session duration of an IAM role defined in AWS.
The Azure SQL Snap Pack now uses the 11.2x driver by default. If you specify any specific driver, ensure that you provide a version higher than 9.1 that is compatible with Microsoft Authentication Library for Java, as this Snap Pack uses the MSAL4J; otherwise, you may run into issues.
Exchange Online
The Exchange Online OAuth2 User Account now does not encounter Access Denied (403) error. Now only the current user details are fetched when you do not have User.Read.All permission in your permissions scope.
The Exchange Online OAuth2 User Account now does not encounter Access Denied (403) error. Now only the current user details are fetched when you do not have a User.Read.All permission in your permissions scope.
The Exchange Online Read Email Snap now shows the email folder suggestions and includes the subfolders' names successfully by prefixing the parent folder name with the '/' delimiter.
The Exchange Online Read Email Snap now downloads the inline attachments correctly when you select the Download attachments checkbox. The Snap now shows the email folder suggestions and includes the subfolder names by prefixing the parent folder name with the delimiter ('/'). For example, custom/subfolder.
The Send Email Snap supports sending the HTML Table in the email body using the following fields:
HTML Table option under Email type
Table Data Path
Batch Size
Eloqua
The Eloqua Snaps now include the Pass through checkbox, which enables the Snap to pass the input document to the output view under the key original.
The Custom Object Metadata ID field in the Eloqua Create Snap allows you to specify an ID for creating custom object data. This conditional field appears only when you select Custom Object Data as the Core object type.
The Excel Formatter and Excel Multi Sheet Formatter Snaps now include a Convert formula strings to formulas checkbox.
The HTTP Client Snap now accepts the default value */* for the Accept header, which communicates to the server that the Snap can handle all forms of response content types.
The Mapper Snap now has a Sorted checkbox in the Input Schema and Target Schema panels, which allows you to sort the input and target schemas. When unchecked, the Snap unsorts the input and the target schema.
Marketo
The Asset Write Snap now supports special characters.
The Asset Read, Asset Write, Lead Read, and Lead Write Snaps now have a new field set, Query Parameters, which enables you to define additional parameters for retrieving the asset details.
Note: Ensure that the query parameters are unique and not defined in both input documents and properties. |
The PostgreSQL - Bulk Load Snap can now process the records with more than 16 KB in the document without encountering the BufferOverflowException because the default value of 16 KB for byte buffer size is now removed.
The S3 Browser Snap output now includes the Storage Class field, which indicates the archived status of the S3 object.
The Snowflake - Bulk Load Snap now routes the 403-Access Denied error to the error view (when the error view is enabled) when you do not have DeleteObject permission to delete the temporary files in the S3 bucket.
The Salesforce Bulk Query Snap now includes the following checkboxes:
Match Data Type: Select this checkbox to match the data types of the bulk query job results.
Object Type: This option appears on selecting the Match Data Type checkbox.
Include Deleted Records: Select this checkbox to include deleted records in the query result.
The SQL Server - Select Snap now has the Convert rowversion datatype to integer checkbox to support the ROWVERSION datatype. Select this checkbox to display the Rowversion datatype as integers in the output.
Fixed the following issues in the Snowflake - Bulk Load Snap:
The Snap failed when the Preserve case sensitivity field was not selected and the column names in the input document and the target table were the same but the cases were different. Now, the Snap does not fail and loads the data correctly to the target table.
The Snap created a table when it did not exist with multiple columns in the target table when there were two input views, but the column name cases were different in both views. Now, the Snap creates the table from the metadata provided by the second input view and loads the data into the target table from the first input view.
The Generic JDBC - Insert Snap previously took a long time to execute and was aborted after a few minutes, which affected the performance of the Snap. Now the Snap takes less time for execution.
MySQL Insert, Oracle Insert, PostgreSQL Insert, Redshift Insert, Snowflake Insert, and SQL Server - Insert: These Database Insert Snaps now create the target table only from the table metadata of the second input view when the following conditions are met:
The Create table if not present checkbox is selected.
The target table does not exist.
The table metadata is provided in the second input view.
The S3 Download Snap no longer fails even when the Pipeline has multiple Snaps after 430patches18348.
Marketo does not support some special characters (for example, (๐๐๐๐ฌ๐ญ๐ฎ๐๐๐ง๐จ๐ฉ๐๐๐๐๐๐
๐๐,๐๐๐ฌ๐๐๐๐๐ด).
The following changes are scheduled for release in 2023 February:
MySQL Snap Pack: The default JAR file of the MySQL Database account does not support connectivity to MYSQL8. To connect to MYSQL8, you must upload a compatible mysql-connector (v.5.1.47 or v8) JAR. In the upcoming February Release, we will upgrade the default MySQL JAR bundled with the MySQL Snap to the latest version that is backward compatible and able to connect to MySQL 8. Learn more about version compatibility in this MySQL article.
In the Execution Overview, Pipeline duration is now the completion time minus the Pipelineโs start time.
The following Patterns were added to the Studio Patterns Catalog.
Automate Customer Onboarding
Bulk Delete Salesforce Contacts in CSV Files
Create Record in Google Sheets for Lead Added or Updated in Marketo
Create SnapLogic Groups and Populate Them with Lists of Users
Data Validator and De-Duplication
Dynamic Data Pivot
Employee Journey: People Analytics
Employee Journey: Recruiting
Errors to Slack and Email
Fetch Candidate Data from Taleo using REST API
Get Check Object Data from NetSuite and Load Them into Redshift
Get Leads from Marketo and Write Them to a CSV File
Get Metrics and Resource utilization on current Snaplexes
Get Product Details from Oracle, SAP, and Salsify
Ingest Data from File Server into AWS Cloud Storage
Ingest Data from Salesforce into AWS Cloud Storage
Insert New Employee Data into Workday
Load Data from Google Storage into Google BigQuery using Avro File Format
Load Multiple Small Files and Their Metadata into Target Such as S3, ADL, HDFS
Load Salesforce contacts into Microsoft Azure Storage (WASB)
Loading Data From Multiple CSV Files Into Two Oracle Tables
Move Data from AWS S3 to Snowflake Data Warehouse
Move Data from a Relational Database Into Teradata
NetSuite Contact to ServiceNow User
Oracle to Salesforce
Replicate Data from Salesforce to Multiple Databases
SAP to Dynamics
Salesforce to Microsoft Azure Data Lake Storage
Salesforce to Microsoft Dynamics 365 Finance and Operations
Salesforce to Tableau
Schema Bulk Load from SQL Server to Snowflake
Search Issues in Jira and Send Them in an Email Message
Send a File to Salesforce as an Attachment
ServiceNow to Microsoft Dynamics 365
SnapLogic Public APIs to Read and Write the Runtime Execution Information
SnapLogic Before and After Control-Break Pipeline
Sync Amazon S3 Files by Inserting Records to Redshift Table
Sync Data from Workday to Anaplan
Sync New Customer between NetSuite and Marketo
Update Employee Data from Oracle to Workday
Workday to Jira
Workday to Oracle and BambooHR