Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Validate is a processor function that operates on data as it passes through a stream. Rules can be configured on data fields in the user interface displayed in the Rules tab or written in JSON file format in the Schema tab. Most rules can be set up in the Rules tab, which automatically generates a JSON schema. For rules that cannot be created using the user interface, you can define them directly in the Schema tab.

...

Sections on this page:

Table of Contents
exclude
minLevelmaxLevel2
maxLevelminLevel2
include
outlinefalse
indent
exclude
stylenone
typelist
classprintabletrue
class

Rules tab

Use the Rules tab to define validation rules on fields. Click + Add rule to create a new rule.

...

FieldSetting

Description

Field

Field name

Select the field from the drop down list or add a field.

Field type

Select the field type from the following options:

  • Primitive - The data type is single value i.e. string, number, integer, boolean, array, object or null.

  • Nested object - The data type is hierarchical with objects inside objects.

  • Nested array - The data type is arrays inside arrays or arrays containing objects.

Validations

Key

This is the rule that will be applied to the selected field.

Value

This is the value for the key. The options will vary based on the selected key.

Schema tab

The Schema tab can be used to define additional validation that is not supported in the Rules tab or as an alternative to the Rules tab. Rules created in the Schema tab may not be fully compatible with the user interface. If this happens, an error message will appear when you switch back to the Rules tab. The validation will still function correctly, but it won’t will not be displayed in the Rules tab. The created or generated schema will be used for validation in the stream, see https://infozone.atlassian.net/wiki/x/EtZ3.

...

Note

Caution!
When adding rules directly to the schema, you must click Apply rules for them to take effect.

Validation

...

rules

The Validate Function function uses normalization rules during validation, see Validate - Normalization Rules. The following validation rules apply:

  • The Validate Function function does not perform strict validation on the input data types.

  • The record that passes through the validation function might be converted to the data type defined in the JSON schema.

  • Validation is done when the input data type can be converted.

Data

...

correction

The records that fail validation are sent to Data Correctioncorrection for further investigation. A record enters data correction when the first validation rule fails and the subsequent validation checks are not done. To enable data correction, select the Send invalid data to Data Correctioncorrection checkbox.  

...