To open the Duplicate UDR agent configuration, click Build → New Configuration. Select Workflow from the Configurations dialog. When prompted to Select workflow type, select Batch. Click Add agent and click the Processing tab. Select Dup UDR from the Agent Selection dialog. Double-click the agent icon or right-click the icon and select Edit agent, to display the Agent Configuration dialog.
The configuration dialog contains the following tabs:
Dup UDR - This tab contains the two subsidiary tabs, Main, and Storage.
Thread Buffer - For further information about the Thread Buffer tab, seeWorkflow Template(4.3).
Main tab
Setting | Description |
|---|---|
Profile | Select the Duplicate UDR(4.3) profile you want the agent to use in the drop-down list. All workflows in the same workflow configuration can use separate Duplicate UDR profiles. To do that, the profile must be set to Default in the Workflow Table tab found in the Workflow Properties dialogue. After that, each workflow in the Workflow Table can be appointed the correct profile. |
Duplicate Route | Indicates on which route to send detected duplicates. The list is not populated with output routes until the routes have been created and the dialogue is reopened. |
Suppress Warnings in System Log | Select this check box to suppress duplicate UDR messages from being logged in the System Log. |
Storage tab
When Kafka storage is selected a disk-based cache will be created on the corresponding EC so there needs to be sufficient space on this disk.
Note!
You need to manage the cleanup of the kafka topic and it’s important to set this to happen quite regularly (clean up settings for this topic - this is found in Kafka) . in order to be efficient with resources. (this is more important for dup UDR/not so much for Data aggregator.
Internal Note: Also Agents will create topics if they don’t already exist, and topic settings may need to be adjusted. eg. if you leave them i.e. use default Kafka may run out of storage
Setting | Description |
|---|---|
Change Topic Name | Select this setting if you want to update the name of the Kafka topic when creating scalable batch workflows, for example, if you create a new workflow and want it to point to the same topic as the previous one. |