Versions Compared

Old Version 17

changes.mady.by.user Felicity Borrelli

Saved on

compared with

New Version Current

changes.mady.by.user Felicity Borrelli

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This section describes the actions you can take after inspecting an invalid record. You can perform these actions on individual or multiple records simultaneously. These actions generate user activity logs.

...

Note!

The maximum number of records allowed for actions is currently set at 100,000 (100k).

To perform an action:

  1. Go to the Detail view page.

  2. Click the Edit button in the top-left section of the toolbar to enable the Edit mode.

...

Info

Records pending reprocessing will be hidden from this view as they cannot be edited.

  1. You can now select the specific records you wish to take action on.

...

  1. When you select records, you will see the available actions on the right-hand side of the toolbar.

...


...


  1. detailedview-edit.pngImage Modified

Correcting a Record

The Correctactionallows you to update the information of an erroneous record. After correcting the records, make sure to select them for reprocessing. See 'Reprocessing a record'below for more informationdetails. 

There are two ways to correct records:

...

Select the record(s) you want to correct and click Correct.

Simple Correction

In the Correct Panel:

  1. Select the target field of the record that you want to correct. If the field is missing from the record, you can add that field using the Add Field option.
    Image Removed
    Target field

    correct_panel_data_correction.pngImage Added


  2. Select the type of the field.

  3. Enter the new value.

  4. Click Apply to correct the changes. This action cannot be undone.

Advanced Correction

You can do an advanced level of record correction by creating a desired expression with pre-defined functions or fields. The field you want to correct is updated with the output of the custom expression. Click on the Guide banner to see a brief explanation of all available functions. 

...

  1. Turn on the Use expression toggle.

    advcorrection_label.pngImage Modified


  2. Select the field you want to correct from the Target field drop-down list. If the field is missing from the list, you can add that field using the Add Field option.


  3. Create the target value by selecting from the available fields, using pre-defined functions, or combining both. This action constructs the expression template in the Expression textbox.

  4. Customize the template to match your specific requirements. The following table provides the list and description of the pre-defined functions provided in the Guide banner: 

Mathematical Function

Description

Example

Numeric functions

Floor

Rounds down to the nearest integer or lower.

floor(3.8) = 3

Ceil

Rounds up to the nearest integer or higher.

ceil(3.8) = 4

Round

Rounds to the nearest integer or decimal places.

round(4.7) = 5

Addition

Adds two or more numbers.

5+3 = 8

Subtraction

Subtracts one number from another.

10 - 6 = 4

Division

Divides one number by another.

10/5=2

Multiplication

Multiplies two or more numbers.

5*3=15

String functions

Uppercase

Converts a string to all uppercase letters.

upperCase("hello") = "HELLO"

Lowercase

Converts a string to all lowercase letters.

lowerCase("WORLD") = "world"

Trim

Removes leading and trailing spaces from a string.

trim(" example ") = "example"

Concatenate

Joins multiple strings together.

concatenate("Hello", " ", "world") = "Hello world"

Slice

Extracts a portion of a string by specifying the start and end.

  • slice (x,y): get the substring of x, starting at index y (y = 0 is first character)

  • slice (x,y,z): Get a slice of z characters from the string x, starting at index y (y= 0 is the first character)

slice("abcdef", 1, 3) = "bc"

Info

Examples

  • If you want to round down the field 'price' from its original value of 1.001 to 1, select the floor function from the Add function dropdown list and then select the field 'price'. Expression will be: floor(@{payload.price})

  • If you want to convert the value of the field 'model' to uppercase then the target field and the field selected in the Add field dropdown will be the same and the function will be Uppercase. Once a selection is done, you will see a template expression created like this: upperCase(x)@{payload.model} where you need to update the expression to upperCase(@{payload.model}).

  1. Since a correction cannot be undone, it is recommended that you test the expression on one single record before doing a bulk change. Click Apply to correct the selected records. You can also select the reprocess checkbox in the confirmation box to reprocess these corrected records.

...

Note!

A bulk action works asynchronously, so once you submit it, it is added to the queue and processed. You must refresh the page for the updated results.

Reprocessing a Record

The Reprocess action enables you to reprocess records by sending the corrected records back to the Validate Function where they are re-validated and once successful, they are forwarded downstream. While the records are being reprocessed they are not available for correction or deletion. If the record failure is results from a result of a temporary issue or misconfigured validation, you can reprocess it without making any corrections.

...

correcting it.

Note!

For batch streams, the reprocessing will take place during the next stream execution, and for real-time streams, it will take place every 60 seconds.

Deleting a Record

The Delete action provides the option to remove a failed record from the system. When you click the Delete option, a confirmation prompt appears to ensure that you want to delete the selected record(s). 

Warningnote

If you use the Delete option, the record will be permanently removed.

...