Overview
Use Validate to validate the data from any collector or processor. This is a processor.
You add a JSON schema to determine if a record is valid or not. The JSON schema describes the structure or content, or both, of the record and discards records that do not match the schema. Validation fields are searchable.
There are two ways of interacting with this node – a Rules selection using dropdown menu entry or by placing code in the Schema section.
Rules Selection
There are two subsections available in the JSON Rules selection: Properties and Objects. Using the relevant “Add Property” or “Add Object” the desired items can be added to the service.
Rules Properties Selection
When the “New Property” button is clicked the users can select the required Property from the dropdown menu selection. A description can be assigned to each property as well.
The user interface allows customers to choose between adding in the Output of the previous function or manually select a field property of their choice.
Validation rules can be entered by clicking on the “Add Validation Rule” button. This adds a row, comprising a Key dropdown menu choice with an assigned Value input field box. Additional lines can be creating created by pressing the “Add Validation Rule” button again, while existing rules can be removed by clicking on the remove icon on the selected row.
Data Correction
The Use Data Correction is Send invalid data correction button is used to enable or disable data correction. Refer to Data Correction for more information.
Validation Types
The Validate node can process instances of different JSON schema types. The current JSON schema implementation supports all data types (number, integer, string, boolean, array, object, or null) and in accordance to the official specifications.
The validation function is dynamic and it will return an appropriate if incorrect values are entered into the system.
The Validate function uses Normalization Rules during validation. The following validation rules apply:
- The Validate function does not perform strict validation on the input data types
- The record that passes through the validation function might be converted to the data type that is defined in the JSON schema.
- Validation is done when the input data type can be converted