Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 3 Next »

You open the Kafka collection agent configuration dialog from a workflow configuration: you can right-click the agent icon and select Configuration..., or double-click the agent icon.

The Kafka collection agent in a real-time workflow

The Kafka collection agent configuration window is displayed when you right-click on the agent and select Configuration... or when you double-click on the agent.

Kafka collection agent configuration
 

SettingDescription

Profile

The name of the profile as defined in the Kafka Profile dialog (select Kafka Profile after clicking the New Configuration button in the Desktop).

All

If enabled, messages will be collected from all of the partitions.

RangeIf enabled, messages will be collected from the range that you specify.
SpecificIf enabled, messages will be collected from the specified partition(s). This is a comma separated list.
Start at beginning

You must determine from which offset you want to start collecting. If enabled, messages are collected from the first offset. If you select this option, there is a risk that messages will be processed multiple times after a restart.

Start at end

You must determine from which offset you want to start collecting. If enabled, messages are selected from the last offset from when the workflow was started. If you select this option, there is a risk that data can be lost after a restart.

Start at requested

You must determine from which offset you want to start collecting. If enabled, you must add an incoming route for the udrs, and when a udr arrives on that route - collection starts from the given offset. You set the offset using the KafkaOffsetUDR in an Analysis agent, see 9.49.7.3 KafkaOffsetUDR. Using this offset option reduces the risk of data loss, and prevents messages from being processed multiple times after a restart. See the example in the KafkaOffsetUDR Example in 9.49.7.3 KafkaOffsetUDR.

  • No labels