Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Field Name

Field Type

Field Dependency

Description

Label*

Default ValueASB Consumer
ExampleASB Consumer

String

N/A

Specify the name for the Snap. You can modify this to be more specific, especially if you have more than one of the same Snap in your Pipeline.

Destination Type

Default Value: QUEUE
Example: TOPIC

Dropdown list

Enables Queue, Topic,and Subscription fields.

Choose an option to which the message needs to be sent. Available options are:

  • QUEUE: Messages are sent to the queue

  • TOPIC: Messages are sent to the topic.

Queue

Default Value: N/A
Example: customers_queue

String/Expression/Suggestion

Enabled if Appears when you select QUEUE for Destination Type.

Specify the queue from which the message should be consumed in ASB. Alternatively, click the Suggestion (blue star) icon to fetch the list of queues corresponding to the Azure Service Bus account and select a queue.

Topic

Default Value: N/A
Example: XYZ

String/Expression/Suggestion

Enabled if Appears when you select TOPIC for Destination Type.

Specify the topic from which the message should be consumed in ASB. Alternatively, click the Suggestion (blue star)icon to fetch the list of topics corresponding to the Azure Service Bus account and select a topic.

Subscription

Default Value: N/A
Example: XYZ

String/Expression/Suggestion

Enabled if Appears when you select TOPIC for Destination Type.

Specify the subscription for the topic. Alternatively, click the Suggestion (blue star)icon to fetch the list of Subscriptions for the topic corresponding to the Azure Service Bus account and select a Subscription.

Processing Mode

Default Value: ASYNCHRONOUS
Example: SYNCHRONOUS

Dropdown list

Enabled if Appears when you select QUEUE for Destination Type.

Select the processing mode to make calls to Azure Service Bus. The available options are:

  • ASYNCHRONOUS

  • SYNCHRONOUS

Prefetch Count

Default Value0
Example10

Integer/Expression

Enabled if Appears when you select ASYNCHRONOUS for Processing Mode.

Specify the number of messages to be read into the buffer before the Snap begins processing. If the field is left empty, the Snap sets it to 0.

Incrementing the prefetch count improves the overall performance of the ASB Consumer Snap. The prefetch count can be a value from 0 (disabled) to 5. If you enter a value which exceeds the recommended limit of 5, a Lint warning is displayed in the pipeline statistics.

Count Down Latch Timeout (in seconds)

Default Value1
Example5

Integer/Expression

Enabled if Appears when you select ASYNCHRONOUS for Processing Mode.

Specify the time interval in seconds to receive the messages.

Note

To read messages constantly from ASB in Asynchronous mode, you must set the Count Down Latch Timeout (in seconds) to 0 or -1.

Acknowledgment Type

Default ValueAcknowledge Message
ExampleDefer Message

Dropdown list

Enabled if Appears when you select ASYNCHRONOUS for Processing Mode.

Select an option for the Acknowledgement type to  determine the action on the receive messages. Select the action to take on the received message The available options are:

  • Defer Message: Indicates that the message is a lower priority and can be processed after higher priority messages.

  • Abandon Message: Discards the message.

  • Acknowledge Message: Ensures that the receiver has read the message.

  • Deadletter Message: Holds the messages that cannot be delivered to the receiver.

Max Message Count

Default Value: -1
Example5

Integer/Expression

Enabled if Appears when you select SYNCHRONOUS for Processing Mode.

Specify the maximum number of messages to read before the Consumer stops. If you provide a negative value, the Snap continuously reads messages.

Max Idle Time (in seconds)

Default Value120
Example100

Integer/Expression

Enabled if Appears when you select SYNCHRONOUS for Processing Mode.

Specify the maximum idle time (in seconds) before the Snap stops to wait for messages.

Batch Pooling

Default Value: Deselected

Checkbox

Enabled if Appears when you select SYNCHRONOUS for Processing Mode.

Select this checkbox to pool multiple messages in a batch.

Max Messages (per poll)

Default Value1
Example12

Integer/Expression

Enabled if Appears when you select Batch Pooling.

Specify the maximum number of messages to read for each poll.

Polling Interval (in milli seconds)

Default Value: N/A
Example250

Integer/Expression

Enabled if Appears when you select Batch Pooling.

Specify the time (in milliseconds) to wait between polls for messages.
We recommend you to leave this field empty.

Message Acknowledge Mode

Default ValueAUTO_ACKNOWLEDGE

Dropdown listN/A

Appears when you select SYNCHRONOUS for Processing Mode.

Choose the mode for acknowledging messages in non-transaction sessions.

  • AUTO_ACKNOWLEDGE

  • PIPELINE_CONTROL

Acknowledgement wait time (in milliseconds)

 

Default Value10
Example5000

Integer

Appears when you select PIPELINE_CONTROL for Message Acknowledge Mode.

Specify the duration for which the Snap should wait to receive acknowledgments from the ASB Acknowledgement Snap. We recommend you to leave this field empty to ensure accurate acknowledgment of every message.

Max Auto-lock Renew Duration (in seconds)

Default Value: 60
Example: 70

Integer/Expression

Enabled if Appears when you select QUEUE for Destination Type.

Specify the maximum time (in seconds) to renew the message lock’s expiration.

Info

The maximum time should be in sync with message lock duration in the queue/topic. By default this is set to 60 seconds. We recommend that you set the maximum time to a value slightly greater than message lock duration for queue/topic, because even after the message lock duration is exhausted, you can still renew the lock to process the message.

Snap Execution

Default ValueValidate & Execute
ExampleExecute only

Dropdown list

N/A

Select one of the three modes in which the Snap executes. Available options are:

  • Validate & Execute: Performs limited execution of the Snap, and generates a data preview during Pipeline validation. Subsequently, performs full execution of the Snap (unlimited records) during Pipeline runtime.

  • Execute only: Performs full execution of the Snap during Pipeline execution without generating preview data.

  • Disabled: Disables the Snap and all Snaps that are downstream from it.

...