Legacy Kafka Batch Collector(4.3)
The Kafka batch collection agent consumes messages from the topic and partitions stated in the Kafka collection agents' configuration , which contains the following settings:
Setting | Description |
---|---|
Profile | Browse and select the profile the agent should use, as defined in the Legacy Kafka Profile (4.3). |
All | Select this option if you want messages to be be collected from all of the partitions. |
Range | Select this option if you want messages to be collected from the range that you specify. |
Specific | Select this option if you want messages to be collected from the specified partition(s). This is a comma separated list. |
Batch Size | Use this fi eld to set the number of messages you want to have in each batch. If this fi eld is set to 0, all messages will be collected in one batch. Note!For performance reasons it is important to set a reasonable batch size. If the batch size is set too low, meaning that many batches are run per second, this will affect the performance. |
Default Offset settings | |
Start at Beginning | Select this option if you want the agent to start collecting from the first message in the queue. |
Start at End | Select this option if you want the agent will start collecting from the last message in the queue. This means that the workflow will not collect anything, but the offset will be updated to the last messages for the next run. |
Input/Output Data
Input Data
Messages from the Kafka Log.