Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

On this Page

...

Overview

Use this Snap to notify the Kafka Consumer Snap to commit an offset at specified metadata in each input document.
Image Modified


Note
  • This Snap should be used only if the Auto commit field in the Consumer Snap is not selected (set to false).
  • This Snap no longer requires a Kafka account.

Prerequisites

  • A Confluent Kafka server with a valid account.
  • The Kafka Acknowledge Snap in a pipeline must receive the metadata from an upstream Snap, for example, a Kafka Consumer Snap.

Support for Ultra Pipelines   

...

Parameter Name

Data Type

DescriptionDefault ValueExample
LabelString
Insert excerpt
File Writer
File Writer
nopaneltrue
Kafka AcknowledgeKafka_Acknowledge
Metadata pathStringRequired. Specify the JSON path of the metadata within each input document. metadata$metadata
Snap ExecutionDrop-down list

Select one of the three following modes in which the Snap executes:

  • Validate & Execute. Performs limited execution of the Snap and generates a data preview during Pipeline validation, then performs full execution of the Snap (unlimited records) during Pipeline runtime.
  • Execute only. Performs full execution of the Snap during Pipeline execution without generating preview data.
  • Disabled. Disables the Snap and all Snaps downstream from it.

Validate & ExecuteValidate & Execute

Troubleshooting

None.

Example

Acknowledging Messages

In this Pipeline, we use the Kafka Producer Snap to produce and send messages to a Kafka topic, the Kafka Consumer Snap to read messages from the topic, and finally the Kafka Acknowledge Snap to acknowledge the number of messages read (message count).

...

Attachments
patterns.*slp, .*zip

...

See Also

...