Searching of the erroneous UDRs and batch files in Data Veracity, changing the state, marking for deletion, force deletion and repair of the UDRs can be performed in the Search UI.

Searching for UDRs

The search operation in Data Veracity is performed based on these steps:

1. Select the specific Data Veracity Profile from a list that appears from the Select Profile combo box. Alternatively, you can also choose to load an existing filter by clicking on the Load Filter button.
   
   
2. Select the UDR input type.
3. Select the specific UDR from a list that appears from the Select UDR combo box. The user will only be able to choose one of the UDR to access.
   
   
4. Click on the Next button to build the query for viewing the data.
   
   
5. Select the fields that you would want to appear in the Query Results. Clicking on Select All button will select every single field in the table and UDR.
   
   

6. Add the Filter rules that you want in the query by clicking on Add Rule. If more than one rule is defined, you would be able to choose between AND or OR by clicking on either of the buttons. You could also add a new group of rules by clicking on the Add Group button to define a nested set of rules for the query.

   
   

7. Click the Next button to execute the query and the results will all be shown in the Query Results section of the page. Users will be able to specifically search for any value in the Query Results using the search bar.
   Users can also define the number of records to be displayed on the page. The default value of records is 20. The range of values allowed are from 1 to 200 records.

   Info!

   By clicking on the View UDR icon, the user will be able to inspect the UDR and see the field and values present inside the it.

   Saving the filter

   To save the filter,  click on the Save button to either save it as a new filter, or to update it if you were using an existing filter to search.

   Info!

   When Data Masking is applied to certain fields in the UDR, the masked fields are still searchable but the data from the fields will be replaced by asterisks. However, users with write access for Data Veracity will still be able to view the data in fields that have their data masked. To learn more about how to apply data masking to the fields, refer to Data Masking Fields - webUI (3.3).

   Note!

   The update_user column will always be inserted as null for new records. 

Searching for Batch

1. Select the specific Data Veracity Profile from a list that appears from the Select Profile combo box. Alternatively, you can also choose to load an existing filter by clicking on the Load Filter button.
   
   
2. Select the Batch input type.
   
   
3. Click on the Next button to build the query for viewing the data.
   
   
4. Select the fields that you would want to appear in the Query Results. Clicking on Select All button will select every single field from the Data Veracity table.
   
   

5. Add the Filter rules that you want in the query by clicking on Add Rule. If more than one rule is defined, you would be able to choose between AND or OR by clicking on either of the buttons. You could also add a new group of rules by clicking on the Add Group button to define a nested set of rules for the query.
   
   

6. Click the Next button to execute the query and the results will all be shown in the Query Results section of the page. Users will be able to specifically search for any value in the Query Results using the search bar.
   Users can also define the number of records to be displayed on the page. The default value of records is 20. The range of values allowed are from 1 to 200 records.

   Saving the filter

   To save the filter,  click on the Save button to either save it as a new filter, or to update it if you were using an existing filter to search.

Additional Actions

Apart from searching for rows from the Data Veracity tables, there are other additional operations that could be executed on the Search UI itself. Users will be able to mark records for deletion, conduct repair, changing of the state and force deletion.

Marking Records for Deletion

UDRs or Batch files could be marked for deletion using the Mark Delete option. Executing this option will give the selected records the PRE_DELETE state and make it available in the Approve Delete UI. For more information about how deletion is approved, refer to Approve Delete - webUI (3.3)

To mark UDRs or Batch files for deletion, select the records you will want to mark for deletion then click on Mark Delete. If you wish to mark all the records in Query Results, then click on the button when all of the records are deselected.

A message will be displayed asking if you are sure that you would want to mark the selected records for deletion. If you click OK, the selected records will have their states marked as PRE_DELETE.

Repairing UDRs

UDRs stored in Data Veracity could be edited and updated by the user to rectify any erroneous values found in the Query Results section. The repair job is conducted following these steps:

1. Select the UDRs in which the user would like to repair the values to.Then click on the Repair Selected button. If you wish to repair all the UDRs, deselect all the UDRs and click on the Repair All button.
   
   

2. Click on the New Rule button and choose from the options available to you. Alternatively, you can load an existing rule. There can be one or multiple rules for each repair rule in Data Veracity. For more information about managing Repair Rules refer to Repair Rules - webUI (3.3)
   
   

3. While creating a new rule,
   You will select the UDR Field in the first combo box.
   You will then select the operation to be conducted in the second combo box. You can choose between Assign, Increase or Decrease for numeric values or Assign, Append, Prepend, Insert, Replace or Trim for string values.
   You can also check the APL check box to allow the include business logic in the form of APL codes into the rule itself.

   
   

   Info!

   Restricted fields will not appear for selection in the combo box. For more information on how to set up restricted fields, refer to Restricted Field - webUI (3.3)

   Repair Behaviour

   When defining repair rules, the rule will only apply to the current Filter Rules created when performing the Search and not on the particular UDR types that are selected for Repair.

   Info!

   If an existing repair rule contains one or more restricted fields, those fields will be grayed out and will be not be editable. The repair task will also not repair the field.

4. Clicking on the Save button will save the Repair Rule as a new rule, but if the Repair Rule is already an existing rule, you have the option to save it as a new filter or to update the existing rule.

5. Click the Execute button to execute the repair job. It will also take you to the Job List page where the repair job will be listed and the user will be able to monitor the progress of the job. For more information on the Job List page, please refer to Job List - webUI (3.3)

Delete Records

Delete is an operation for the user to completely remove the record from the Data Veracity database tables without marking the record for deletion.

To delete, select the record or several records that you want to delete from Query Results. then click on the Delete button. If you wish to delete all the records listed in Query Results, then click on the gear icon and select Delete option to delete all records.

A message will be displayed asking if you would want to permanently remove the selected records. If you click OK, the selected records will be completely removed from the Data Veracity database tables.

Setting the State of a UDR

Set state is an operation for the user to manipulate the state of the records. There are a total of 5 different states in Data Veracity: NEW, UPDATED, PRE_DELETE, REPROCESSED and DELETE_APPROVED. Each of these states signify the current status of the records where:

• NEW is for newly inserted records from the Data Veracity Forwarding Agent or from cancelled batches.
• UPDATED is for records that has been through a successful repair job execution.
• PRE_DELETE is for records that have been marked for deletion.
• REPROCESSED is for records that have been collected by the Data Veracity Collection Agent.
• DELETE_APPROVED is for records that have been approved for deletion by an administrator.

To set a state, select the record or several records that you want to set the state for on Query Results and click on the Set State button, then choose from the five states to set the records to. If you wish to set the state for all the records listed in Query Results, Click on the gear icon and select Set State option and choose from the five states available to set all the records to.

A message will be displayed asking if you are sure that you want to change the state to the selected new state. If you click OK, the selected records will have their states changed.

Export UDRs as CSV

Data Veracity allows the user to export all records in the search result into a zipped CSV file.

To export the records into CSV, click on the Export button , then enter the filename and the value that will be the delimeter for the CSV file. Clicking on OK will start the process to save all records into the CSV file and then zipping it.

Checking Include Header option will have generate the header title into the CSV file. Leaving it unchecked will generate a file populated only with records.