Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Searching of the erroneous UDRs and batch files in Data Veracity, changing the state, marking for deletion, force deletion and repair of the UDRs can be performed in the Search UI.

Searching for UDRs

The search operation in Data Veracity is performed based on these steps:

Note
titleUnsupported Data Type for Search

Searching, filtering, repairing and masking of UDRs with list and map data types are currently not supported by Data Veracity.


  1. Select the specific Data Veracity Profile from a list that appears from the Select Profile combo box. Alternatively, you can also choose to load an existing filter by clicking on the Load Filter button.

  2. Select the UDR input type.
  3. Select the specific UDR from a list that appears from the Select UDR combo box. The user will only be able to choose one of the UDR to access.

  4. Click on the Next button to build the query for viewing the data.

  5. Select the fields that you would want to appear in the Query Results. Clicking on Select All button will select every single field in the table and UDR.

  6. Add the Filter rules that you want in the query by clicking on Add Rule. If more than one rule is defined, you would be able to choose between AND or OR by clicking on either of the buttons. You could also add a new group of rules by clicking on the Add Group button to define a nested set of rules for the query.


  7. Click the Next button to execute the query and the results will all be shown in the Query Results section of the page. Users will be able to specifically search for any value in the Query Results using the search bar.
    Users can also define the number of records to be displayed on the page. The default value of records is 20. The range of values allowed are from 1 to 200 records.

    Info
    titleInfo!

    By clicking on the View UDR icon, the user will be able to inspect the UDR and see the field and values present inside the it.


    Info
    titleSaving the filter

    To save the filter,  click on the Save button to either save it as a new filter, or to update it if you were using an existing filter to search.


    Info
    titleInfo!

    When Data Masking is applied to certain fields in the UDR, the masked fields are still searchable but the data from the fields will be replaced by asterisks. However, users with write access for Data Veracity will still be able to view the data in fields that have their data masked. To learn more about how to apply data masking to the fields, refer to Data Masking Fields(3.0).


Searching for Batch

  1. Select the specific Data Veracity Profile from a list that appears from the Select Profile combo box. Alternatively, you can also choose to load an existing filter by clicking on the Load Filter button.

  2. Select the Batch input type.

  3. Click on the Next button to build the query for viewing the data.

  4. Select the fields that you would want to appear in the Query Results. Clicking on Select All button will select every single field from the Data Veracity table.

  5. Add the Filter rules that you want in the query by clicking on Add Rule. If more than one rule is defined, you would be able to choose between AND or OR by clicking on either of the buttons. You could also add a new group of rules by clicking on the Add Group button to define a nested set of rules for the query.

  6. Click the Next button to execute the query and the results will all be shown in the Query Results section of the page. Users will be able to specifically search for any value in the Query Results using the search bar.
    Users can also define the number of records to be displayed on the page. The default value of records is 20. The range of values allowed are from 1 to 200 records.


    Info
    titleSaving the filter

    To save the filter,  click on the Save button to either save it as a new filter, or to update it if you were using an existing filter to search.


Additional Actions

Apart from searching for rows from the Data Veracity tables, there are other additional operations that could be executed on the Search UI itself. Users will be able to mark records for deletion, conduct repair, changing of the state and force deletion.

Marking Records for Deletion

UDRs or Batch files could be marked for deletion using the Mark Delete option. Executing this option will give the selected records the PRE_DELETE state and make it available in the Approve Delete UI. For more information about how deletion is approved, refer to Approve Delete(3.0)

To mark UDRs or Batch files for deletion, select the records you will want to mark for deletion then click on Mark Delete. If you wish to mark all the records in Query Results, then click on the button when all of the records are deselected.

A message will be displayed asking if you are sure that you would want to mark the selected records for deletion. If you click OK, the selected records will have their states marked as PRE_DELETE.

Repairing UDRs

UDRs stored in Data Veracity could be edited and updated by the user to rectify any erroneous values found in the Query Results section. The repair job is conducted following these steps:

  1. Select the UDRs in which the user would like to repair the values to.Then click on the Repair Selected button. If you wish to repair all the UDRs, deselect all the UDRs and click on the Repair All button.

  2. Click on the New Rule button and choose from the options available to you. Alternatively, you can load an existing rule. There can be one or multiple rules for each repair rule in Data Veracity. For more information about managing Repair Rules refer to Repair Rules(3.0)

  3. While creating a new rule,
    You will select the UDR Field in the first combo box.
    You will then select the operation to be conducted in the second combo box. You can choose between Assign, Increase or Decrease for numeric values or Assign, Append, Prepend, Insert, Replace or Trim for string values.
    You can also check the APL check box to allow the include business logic in the form of APL codes into the rule itself.


    Info
    titleInfo!

    Restricted fields will not appear for selection in the combo box. For more information on how to set up restricted fields, refer to Restricted Field(3.0)


    Warning
    titleRepair Behaviour

    When defining repair rules, the rule will only apply to the current Filter Rules created when performing the Search and not on the particular UDR types that are selected for Repair.


    Info
    titleInfo!

    If an existing repair rule contains one or more restricted fields, those fields will be grayed out and will be not be editable. The repair task will also not repair the field.


  4. Clicking on the Save button will save the Repair Rule as a new rule, but if the Repair Rule is already an existing rule, you have the option to save it as a new filter or to update the existing rule.

  5. Click the Execute button to execute the repair job. It will also take you to the Job List page where the repair job will be listed and the user will be able to monitor the progress of the job. For more information on the Job List page, please refer to Job List(3.0)

Delete Records

Delete is an operation for the user to completely remove the record from the Data Veracity database tables without marking the record for deletion.

...

A message will be displayed asking if you would want to permanently remove the selected records. If you click OK, the selected records will be completely removed from the Data Veracity database tables.

Setting the State of a UDR

Set state is an operation for the user to manipulate the state of the records. There are a total of 5 different states in Data Veracity: NEW, UPDATED, PRE_DELETE, REPROCESSED and DELETE_APPROVED. Each of these states signify the current status of the records where:

...

A message will be displayed asking if you are sure that you want to change the state to the selected new state. If you click OK, the selected records will have their states changed.

Export UDRs as CSV

Data Veracity allows the user to export all records in the search result into a zipped CSV file.

...