9.15.5.1 Search

Owned by Jenni Wallin
Last updated: May 10, 2023 by Former user (Deleted)
8 min read

Searching of the erroneous UDRs in Data Veracity, changing the state, marking for deletion, force deletion and repair of the UDRs can be performed in the Search UI, which is accessed at:

http://<platform host>:<web interface port>/mz/#/dataveracity/search

Note!

Authorization is required, and you will be asked to enter user name and password in order to access the Web UI.


Data Veracity Search Web UI

Searching for UDRs

The search operation in Data Veracity is performed based on these steps:

Unsupported Data Type for Search

Searching or filtering of UDRs with list and map data types are currently not supported by Data Veracity.


  1. Select the specific Data Veracity Profile from a list that appears from the Select Profile combo box.

  2. Select the specific UDR from a list that appears from the Select UDR combo box. The user will only be able to choose one of the UDR to access.


    Example - Selecting UDR for the query

  3. Click on the Select button to enter the Query section.

  4. Select the specific fields that you would want to appear in the Query Results. Clicking on Select All button will select every single field in the UDR.


    Example - Selecting Fields for the query

  5. Select the State that you would want to appear in the Query Results. Clicking on Select All button will select every single State available.

    Example - Selecting the State for the query

  6. Add the Filter rules that you want in the query. If more than one rule is defined, you would be able to choose between AND or OR by clicking on either of the buttons. You could also add a new group of rules by clicking on the Add Group button to define a nested set of rules for the query. Clicking on the  icon will allow you to load a previously saved Filter Rule. For more information about managing Filter Rules refer to 9.15.5.4 Filters

    Clicking on the button will save the Filter Rule as a new rule, but if the Filter Rule is already an existing rule, clicking on the button will overwrite any previously saved version of the Filter Rule.


    Example - Selecting the Filter Rules for the query

  7. Click the button to execute the query and the results will all be shown in the Query Results section of the page. Users will be able to specifically search for any value in the Query Results using the search bar.
    Users can also define the number of rows to be displayed on the page. The default value of rows is 500. The range of values allowed are from 1 to 500 rows.

    Info!

    By clicking on theicon, the user will be able to inspect the UDR and see the field and values present inside the it.




    Example - Query Result display

Additional Actions

Apart from searching for UDRs in the Data Veracity tables, there are other additional operations that could be executed on the Search UI itself. The Action button is accessible from the Query Results section and allows the user to mark UDRs for deletion, conduct repair, changing of the UDR state and force deletion.

Query Result Action table

Marking UDRs for Deletion

UDRs could be marked for deletion using the Mark Delete Selected/All option. Executing this option will give the selected UDR the PRE_DELETE state and make it available in the Approve Delete Web UI. For more information about how deletion is approved, refer to 9.15.5.6 Approve Delete

To mark UDRs for deletion, select the UDRs you will want to mark for deletion then click on the icon and select Mark Delete Selected. If you wish to mark all the UDRs listed in Query Results, then choose the Mark Delete All option instead.

A message will be displayed asking if you are sure that you would want to mark the selected UDRs for deletion. If you click OK, the selected UDRs will have their states marked as PRE_DELETE.

Example - Marking a UDR for deletion

Repairing UDRs

UDRs stored in Data Veracity could be edited and updated by the user to rectify any erroneous values found in the Query Results section. The repair job is conducted following these steps:

  1. Select the UDRs in which the user would like to repair the values to. Then click on the Action button and choose the Repair Selected option. If you wish to repair all the UDRs listed in Query Results, then choose the Repair All option instead.

    Example - Selecting UDRs for repair

  2. A new section called Repair Records will open up and allow the user to input the repair rules. There can be one or multiple rules for each repair rule in Data Veracity.
    You will select the UDR Field in the first combo box.
    You will then select the operation to be conducted in the second combo box. You can choose between Assign, Increase or Decrease for numeric values or Assign, Append, Prepend, Insert, Replace or Trim for string values.
    You can also check the APL check box to allow the include business logic in the form of APL codes into the rule itself.


    Info!

    Restricted fields will not appear for selection in the combo box. For more information on how to set up restricted fields, refer to 9.15.5.7 Restricted Field

    Repair Behaviour

    When defining repair rules, the rule will only apply to the current Filter Rules created when performing the Search and not on the particular UDR types that are selected for Repair.


    Clicking on the  icon will allow you to load a previously saved Repair Rule. For more information about managing Repair Rules refer to 9.15.5.5 Repair Rules

    Info!

    If an existing repair rule contains one or more restricted fields, those fields will be grayed out and will be not be editable. The repair task will also not repair the field.


  4. Clicking on the button will save the Repair Rule as a new rule, but if the Repair Rule is already an existing rule, clicking on the button will overwrite any previously saved version of the Repair Rule.


    Example - Filing up a repair rule for a repair job

  5. Click the button to execute the repair job. It will also take you to the Job List page where the repair job will be listed and the user will be able to monitor the progress of the job. For more information on the Job List page, please refer to 9.15.5.2 Job List

Delete a UDR

Delete is an operation for the user to completely remove the UDR from the Data Veracity database tables without marking the UDR for deletion.

Note!

Delete is only available to users with the write access to the Data Veracity module in the Access Control.


To Delete the UDR, select the UDR or several UDRs that you want to delete from Query Results. Click on the Action button and select Delete Selected. If you wish to force delete all the UDRs listed in Query Results, then choose the Delete All option instead.

A message will be displayed asking if you are sure that you would want to permanently remove the selected UDRs. If you click OK, the selected UDRs will be completely removed from the Data Veracity database tables.

Example - Deleting UDRs

Setting the State of a UDR

Set state is an operation for the user to manipulate the states for the UDR. There are a total of 5 different states in Data Veracity: NEW, UPDATED, PRE_DELETE, REPROCESSED and DELETE_APPROVED. Each of these states signify the current status of the UDR where:

  • NEW is for newly inserted UDRs from the Data Veracity Forwarding Agent.
  • UPDATED is for UDRs that has been through a successful repair job execution.
  • PRE_DELETE is for UDRs that have been marked for deletion.
  • REPROCESSED is for UDRs that have been collected by the Data Veracity Collection Agent.
  • DELETE_APPROVED is for UDRs that have been approved for deletion by an administrator.

Note!

Set state is only available to users with the write access to the Data Veracity module in the Access Control.

To set a state, select the UDR or several UDRs that you want to set the state for on Query Results. Click on the Action button and select Set Selected State, then choose from the five states to set the UDR to. If you wish to set the state for all the UDRs listed in Query Results, then select the Set All State option and choose from the five states available to set all the UDRs to.

A message will be displayed asking if you are sure that you want to change the state to the selected new state. If you click OK, the selected UDRs will have their states changed.

Example - Updating UDR states

Export UDRs as CSV

Data Veracity allows the user to export all UDRs in the search result into a zipped CSV file.

Example - Exporting UDRs to CSV

To export the records into CSV, click on the  icon , then input the value that will be the separator and the filename for the CSV file. Clicking on Export will start the process to save all records into the CSV file and then zipping it.

Checking Include Header option will have generate the header title into the CSV file. Leaving it unchecked will generate a file populated only with UDRs.

Clear Selection

Clear Selection is an operation that clears all selected UDRs across all the pages, allowing the user to make new selections.