Data Veracity Collection Agent Configuration
- Kevin Wu
To open the Data Veracity collection agent configuration dialog from a workflow configuration, you can do either one of the following:
double-click the agent icon
select the agent icon and click the  Edit button
You can select to collect data from an Error Code that has been defined in Data Veracity in Data Management or from a filter that has been saved in Data Veracity Search.
The available settings in the Agent Configuration dialog depends on the the UDR type option.
Data Veracity - UDR Type
Â
Data Veracity collection configuration for UDR type
Setting | Description |
|---|---|
Profile | Click Browse to select a predefined Data Veracity Profile. The profile contains details about the Data Veracity For further information, see Data Veracity Profile. |
Type | UDR and Batch radio button here will be enabled according to the selected Data Veracity Profile. Select either UDR or Batch to determine if the agent will be collecting UDRs or Batch files from the Data Veracity tables. The Collection agent can only collect either UDR or Batch at any one time.  |
Filtering |  Collection Configuration dialog for UDR type Click Add to configure the following Collection Configuration:
|
Reprocessing | |
Collection Size | Collection Size is the value that defines how many UDRs will be collected before the collection agent finishes the current batch and starts a new one. The default value is 5000. The range for the value is 1 - 100000. This field is only available for collecting UDR. |
SQL Bulk Size | To improve performance, data records are retrieved in bulk. The SQL Bulk Size value specifies how many records that will be included in each bulk.  The default value is 1000. The range for the value is 1 - 100000. |
State | This combo box displays a list of states that indicates which UDRs with the corresponding state to collect from the database. The choices presented in the list are NEW, UPDATED and NEW or UPDATED. The default value is NEW or UPDATED. This field is only available for collecting UDR. |
Read Only | Select this option to have the agent retrieve the Data Veracity UDRs or Batch records without updating the state of the records from the database. Such as, UDRs that were collected with the state NEW will not have its state changed to REPROCESSED when Read Only is enabled. |
Data Veracity - Batch Type
Data Veracity collection configuration for Batch type
Setting | Description |
|---|---|
Profile | Click Browse to select a predefined Data Veracity Profile. The profile contains details about the Data Veracity For further information, see Data Veracity Profile. |
Type | UDR and Batch radio button here will be enabled according to the selected Data Veracity Profile. Select either UDR or Batch to determine if the agent will be collecting UDRs or Batch files from the Data Veracity tables. The Collection agent can only collect either UDR or Batch at any one time.  |
Filtering | Collection Configuration dialog for batch type Click Add to configure the following Collection Configuration:
|
Reprocessing | |
SQL Bulk Size | To improve performance, data records are retrieved in bulk. The SQL Bulk Size value specifies how many records that will be included in each bulk.  The default value is 1000. The range for the value is 1 - 100000. |
Read Only | Select this option to have the agent retrieve the Data Veracity UDRs or Batch records without updating the state of the records from the database. Such as, UDRs that were collected with the state NEW will not have its state changed to REPROCESSED when Read Only is enabled. |