Data correction

Open

Data correction is available in all solutions and you can use it to collect and modify invalid records so they can be reprocessed in a stream. When a stream processes data, records that fail validation against the rules configured in the Validate function are sent to Data correction for further investigation. See Validate for more information.

Once a record is available in Data correction, you can decide to correct, reprocess, or delete the record. Once corrected and reprocessed, records are sent back to the Validate function and re-validated. If no validation rule fails, the records are processed further in the stream. 

You can configure E-mail notifications to be sent to specified recipients whenever a new record is sent to Data correction.

Open

The Data correction and reprocessing flow

Logs are generated whenever records are sent and reprocessed from Data correction. Records in Data correction are grouped by the error.

A record is stored in Data correction for six months from the time it was last updated.

You cannot delete a solution, stream, or a Validate function when data exists in Data correction. You must first delete all relevant records.

This section has the following subsections: