- Created by Diane Miller, last modified by Sandhya Sriram on Jul 22, 2022
You are viewing an old version of this page. View the current version.
Compare with Current View Page History
« Previous Version 117 Next »
In this article
Articles in this Section
Overview
You can use this Snap Pack for accessing Apache Kafka and Confluent Kafka to produce and consume messages.
Supported Versions
The 4.30 release of this Snap Pack uses the following client libraries:
Apache-Kafka Version 3.1.1
Confluent-Kafka Version 7.1.1
Temporary Files
During execution, data processing on Snaplex nodes occurs principally in-memory as streaming and is unencrypted. When larger datasets are processed that exceed the available compute memory, Snap writes Pipeline data to local storage as unencrypted to optimize the performance. These temporary files are deleted when the Snap/Pipeline execution completes. You can configure the temporary data's location in the Global properties table of Snaplex's node properties, which can also help avoid Pipeline errors due to the unavailability of space. For more information, see Temporary Folder in Configuration Options.
Snap Pack History
Release | Snap Pack Version | Date | Type | Updates |
---|---|---|---|---|
4.29 Patch | 429patches17109 | Latest |
| |
4.29 | main15993 | Stable | Kafka Snap Pack now supports Azure Event Hubs streaming service. Learn more: Azure Event Hubs configuration in Azure portal for Kafka SSL Account. | |
4.28 Patch | 428patches14904 | Latest | Fixed an issue with Kafka Snaps where the Snaps failed with null pointer exceptions when logging the cluster information with the controller’s identity not known. | |
4.28 | main14627 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.27 | main12833 | | Stable | Upgraded with the latest SnapLogic Platform release. |
4.26 | main11181 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.25 Patch | 425patches10543 | Latest |
| |
4.25 | main9554 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.24 Patch | 424patches8805 | Latest | Fixed an issue in the Kafka Producer Snap by removing the validation of the account when the Snap initialized in a Pipeline execution. | |
4.24 | main8556 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.23 Patch | 423patches7900 | Latest |
| |
4.23 | main7430 | Stable | Fixed an intermittent issue of Confluent Kafka Consumer Snap stopping when Message Count is 0 while the records are available. The Snap will now stop only if a poll returns no records twice in a row, and has partitions assigned before and after each poll. | |
4.22 | main6403 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.21 Patch | 421patches6136 | Latest | Enhanced the Confluent Kafka Consumer Snap with an option to allow reprocessing of records that remain unacknowledged due to acknowledge timeouts. This ensures that all records from Kafka are processed. | |
4.21 Patch | 421patches5862 | Latest | Fixes the Confluent Kafka Consumer Snap that aborts abruptly upon getting a | |
4.21 | snapsmrc542 |
| Stable | Enhanced the Confluent Kafka Consumer Snap to significantly reduce the volume of commit requests for offsets when using the Record acknowledgement mode (Wait after each record), and thereby, improve performance and stability. |
4.20 Patch | confluentkafka8747 | Latest | Updated the Confluent Kafka SSL Account settings to make the Truststore filepath and Truststore password properties optional. | |
4.20 | snapsmrc535 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.19 | snaprsmrc528 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.18 Patch | confluentkafka8111 | Latest | Fixed an issue with the Confluent Kafka Producer Snap wherein the Topic property doesn't evaluate expression against input documents. | |
4.18 Patch | confluentkafka8006 | Latest | Fixed an exception that occurs while consuming log-compacted topics, in the Confluent Kafka Consumer Snap. | |
4.18 Patch | confluentkafka7784 | Latest | Fixed the Consumer Snap to stop quickly and cleanly on CLOSE and STOP lifecycle events. | |
4.18 Patch | confluentkafka7732 | Latest | Added support for Kerberos-based authentication to enable connecting to Kerberos-enabled Kafka servers. | |
4.18 | snapsmrc523 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.17 Patch | confluentkafka7537 | Latest | Updated the following Snaps:
| |
4.17 | ALL7402 | Latest | Pushed automatic rebuild of the latest version of each Snap Pack to SnapLogic UAT and Elastic servers. | |
4.17 | snapsmrc515 | Latest |
| |
4.16 Patch | confluentkafka7118 | Latest | Fixed an issue with the Confluent Kafka Producer Snap wherein the Snap fails to produce the upstream Snap's input schema for Partition Number property in the output preview. | |
4.16 Patch | confluentkafka6891 | Latest | Certified Confluent Platform version 5.x. | |
4.16 | snapsmrc508 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.15 Patch | confluentkafka6446 | Latest | Fixed an issue with the Confluent Kafka Consumer Snap wherein some connections were not closed after a Pipeline is aborted. | |
4.15 | snapsmrc500 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.14 Patch | confluentkafka5737 | Latest | Added a new property to the Confluent Kafka Producer Snap, Message publish timeout (milliseconds), that lets you specify a timeout value. | |
4.14 Patch | confluentkafka5663 | Latest | Fixed the Confluent Kafka Snaps that do not delete temp files after pipeline execution. | |
4.14 | snapsmrc490 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.13 Patch | confluentkafka5614 | Latest | Fixed the Confluent Kafka Snap Pack that does not delete the temp files after executing pipelines. | |
4.13 Patch | confluentkafka5330 | Latest | Added support in Confluent Kafka Producer Snap the ability to write data to multiple partitions, in a round robin fashion. | |
4.13 | snapsmrc486 | Stable | Upgraded with the latest SnapLogic Platform release. | |
4.12 Patch | confluentkafka5087 | Latest | Fixed an issue with the Consumer Snap that fails when the specified timeout value is less than the pipeline execution time. | |
4.12 | snapsmrc480 | Stable | Enhanced the performance of the Confluent Kafka Producer Snap in writing incoming documents into the Confluent Kafka Cluster. | |
4.11 Patch | confluentkafka4626 | Latest | Fixed an issue with the Confluent Kafka Consumer Snap wherein the Consumer session is not closing properly when manually stopping a pipeline, which causes the subsequent pipeline execution to wait for the previous session to die and not consume messages. | |
4.11 Patch | confluentkafka4302 | Latest | Fixed an issue with the Confluent Kafka Consumer Snap that fetched 500 messages only, when message count set to 0 caused due to driver default value change. | |
4.11 | snapsmrc465 | Stable | Updated the Confluent Kafka SSL Account with SCRAM_SASL support. | |
4.10 | snapsmrc414 | Stable | Confluent v3.2 support for Confluent Kafka Snap Pack. | |
4.9 Patch | confluentkafka3156 | Latest | Fixed an issue regarding account validation failure due to unauthorized topics; Enhance the error message for empty topic suggestions | |
4.9 | snapsmrc405 | Stable |
| |
4.8 Patch | confluentkafka2804 | Latest | Addressed an issue with Confluent Kafka Producer not including input document schema in Message Key and Value expression properties | |
4.8 | snapsmrc398 | Stable | New Snap Pack for 4.8. It consists of Confluent Kafka Consumer and Confluent Kafka Producer. |
Related Links
- No labels