9.49.6.1 Kafka Real-time Collection Agent Configuration
- Jenni Wallin
- Former user (Deleted)
- Karthik Bangalore
You open the Kafka collection agent configuration dialog from a workflow configuration: you can right-click the agent icon and select Configuration..., or double-click the agent icon.
The Kafka collection agent in a real-time workflow
The Kafka collection agent configuration window is displayed when you right-click on the agent and select Configuration... or when you double-click on the agent.
Kafka collection agent configuration
| Setting | Description |
|---|---|
Profile | The name of the profile as defined in the Kafka Profile dialog (select Kafka Profile after clicking the New Configuration button in the Desktop). |
All | If enabled, messages will be collected from all of the partitions. |
| Range | If enabled, messages will be collected from the range that you specify. |
| Specific | If enabled, messages will be collected from the specified partition(s). This is a comma separated list. |
| Start at beginning | You must determine from which offset you want to start collecting. If enabled, messages are collected from the first offset. If you select this option, there is a risk that messages will be processed multiple times after a restart. |
| Start at end | You must determine from which offset you want to start collecting. If enabled, messages are selected from the last offset from when the workflow was started. If you select this option, there is a risk that data can be lost after a restart. |
| Start at requested | You must determine from which offset you want to start collecting. If enabled, you must add an incoming route for the udrs, and when a udr arrives on that route - collection starts from the given offset. You set the offset using the |
Note!
Any security related configuration change of the Kafka server require that any topics used by must be recreated before they can be used.