Page Comparison

Consumer Group

The name of the consumer group which is defined by the group.id property.

Batch Size

The number of messages to collect per batch. Note that a workflow will remain in running state even when all data has been consumed and you have to trigger a stop either using mzcli, or the operations REST interface or in the workflow configuration by using a MIM like Estimated Lag or Workflow Throughput, for example.

The Batch Size must be greater than 0.

Assignment

Messages can be collected from one or several topics. You define how the topics should be identified by selecting either;

Topic Pattern
Enter a regular expression for the names of the topics you want to collect data from. https://docs.oracle.com/en/java/javase/15/docs/api/java.base/java/util/regex/Pattern.html

Topic Names
Select this option to display a list and an Add button. Add one or several topic names that you want to collect data from. The exact names must be entered. Regular expressions cannot be used.

Topic Partitions
Select this option to display a list and an Add button. Add one or several topic names and partitions that you want to collect data from. You must enter the The exact names must be entered. Regular expressions cannot be used.

Below are a few examples of valid partition declarations:

Example of collection from partition 0:

Partitions: 0

Example of collection from the three partitions 0, 8 and 12:

Partitions: 0,8,12

Example of collection from the six partitions 0, 3, 4, 5, 6, and 7:

Partitions: 0,3-7