Duplicate Batch Agent

This section describes the Duplicate Batch profile, the Duplicate Batch Detection agent, and the Duplicate Batch Inspector. This processing agent is available in batch workflow configurations.

The Duplicate Batch agent allows duplication control on passed data batches. Each data batch is tested against already stored metadata from batches, to see if they are considered to be duplicates. Metadata for data batches are kept for a configurable number of days. If the metadata of a batch has been removed, a duplicate of this batch can no longer be detected.

If any duplicates are detected, a message is logged to the System Log, and the duplicate batch is canceled, which may cause the workflow to abort. For further information, see System Log.

To monitor the duplicate batches, the Duplicate Batch Inspector may be used. See Duplicate Batch Inspector.

It is only appropriate to use the agent after agents that may create duplicate batches, typically a file-based collection agent. Several workflows may utilize the same Duplicate Batch profile. In this case, their batches are mutually compared.