In this article
...
You can use the Kafka Acknowledge Snap to notify the Kafka Consumer Snap to commit an offset at the specified metadata in each input document.
| Note |
|---|
|
Prerequisites
- A Confluent Kafka server.
An upstream Snap (for example, a Kafka Consumer Snap) that sends metadata to the Kafka Acknowledge Snap in a Pipeline.
...
| Parameter Name | Data Type | Description | Default Value | Example | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Label | String |
| Kafka Acknowledge | Kafka_Acknowledge | ||||||||
| Metadata path | String | Required. Specify the JSON path of the metadata within each input document. | metadata | $metadata | ||||||||
| Snap Execution | Drop-down list | Select one of the three modes in which the Snap executes:
| Validate & Execute | Validate & Execute |
...
First, we use the Sequence Snap to enable the Pipeline to send documents in large numbers. We configure the Sequence Snap to send all the documents starting from 1 through 2500. Hence, we set the Initial value as 1 and Number of documents as 2500.
We configure the Kafka Producer Snap to send the documents to the Topic named SampleKafkaTopic and we set the Partition number to 0 to let the broker decide which partition to use.
...
| Attachments | ||
|---|---|---|
|
...
See Also
- Apache Kafka
- Confluent - Schema Registry
- Getting Started with SnapLogic
- Snap Support for Ultra PipelinesSnapLogic Product Glossary
| Insert excerpt | ||||||
|---|---|---|---|---|---|---|
|