Validate - configuration
- Felicity Borrelli
- Jenni Wallin
Validate is a processor function that operates on data as it passes through a stream. Rules can be configured on data fields in the user interface displayed in the Rules tab or written in JSON file format in the Schema tab. Most rules can be set up in the Rules tab, which automatically generates a JSON schema. For rules that cannot be created using the user interface, you can define them directly in the Schema tab.
Sections on this page:
Rules tab
Use the Rules tab to define validation rules on fields. Click + Add rule to create a new rule.
Setting | Description |
|---|---|
Field | |
Field name | Select the field from the drop down list or add a field. |
Field type | Select the field type from the following options:
|
Validations | |
Key | This is the rule that will be applied to the selected field. |
Value | This is the value for the key. The options will vary based on the selected key. |
Schema tab
The Schema tab can be used to define additional validation that is not supported in the Rules tab or as an alternative to the Rules tab. Rules created in the Schema tab may not be fully compatible with the user interface. If this happens, an error message will appear when you switch back to the Rules tab. The validation will still function correctly, but it will not be displayed in the Rules tab. The created or generated schema will be used for validation in the stream, see https://infozone.atlassian.net/wiki/x/EtZ3.
Hint!
When adding multi level validation, add the deepest level first. Subsequent rules should be higher level.
Caution!
When adding rules directly to the schema, you must click Apply rules for them to take effect.
Validation rules
The Validate function uses normalization rules during validation, see Validate - normalization rules. The following validation rules apply:
The Validate function does not perform strict validation on the input data types.
The record that passes through the validation function might be converted to the data type defined in the JSON schema.
Validation is done when the input data type can be converted.
Data correction
The records that fail validation are sent to Data correction for further investigation. A record enters data correction when the first validation rule fails and the subsequent validation checks are not done. To enable data correction, select the Send invalid data to Data correction checkbox.