Validate
With the Validate function, you can ensure data accuracy by applying user-defined validation rules to incoming records. These rules, specified via the user interface or a JSON schema, can validate one or multiple fields. The function is typically placed early in the stream, immediately after the data entry point, to catch issues before further processing. Alternatively, it can validate the final output at the end of the stream, ensuring only clean and accurate data is stored or forwarded. In the example below, the Validate function follows the Script function, which acts as a data simulator. The Validate function also supports data correction, allowing invalid records to be collected for review, analysis, and reprocessing.
Subsections
This section contains the following subsections: