There are four types of workflow configurations:

• Batch

• Real-Time

• Task

• System Task

Batch Workflow

A batch workflow processes input from a specific source, usually a file. The workflow creates batches from the data and processes them one by one.  

In a batch workflow data is collected by a single collecting agent in a transaction-safe manner. A single batch is collected (only once) and is fully processed by the workflow before the next batch is collected.  

A batch workflow:  

• Processes batches, one at a time.

• Is started either manually or by a scheduled trigger.  

• Stops either when it finishes processing the input, or when aborted.

Real-Time Workflow

Real-time workflows are used in systems where instant processing requests need to be addressed as they occur.

In real-time workflows most of the collecting agents communicate in a two-way manner; they receive requests and provide replies.

A real-time workflow:

•   Can have more than one collecting agent

• Once started, the real-time workflows remain active. A real-time workflow is started either manually or by a scheduled trigger and stops either manually or due to an error.

• Processes reside in memory. Transaction safety must be handled prior to collection and after distribution.

• Errors are registered in the System Log and the workflow continues to run. Real-time workflow error handling rarely leads to workflow aborts.

Task Workflows

Task workflows are single-agent workflows that execute user-defined SQL, shell scripts, or unit tests.

System Task Workflows

Usage Engine comes with built-in System Task workflows. System Task workflows and groups let you perform activities such as log and run-time data cleanup.

System Task workflows include the following types:

• Archive Cleaner

• Configuration Cleaner

• Data Veracity Maintenance

• ECS Maintenance

• Statistics Cleaner

• System Backup

• System Log Cleaner

• User Cleanup

This section includes information about:

• Opening a System Task Workflow

• Modifying a System Task Workflow Configuration

Opening a System Task Workflow

1. The System Task Workflow is open from the workflow configurations list (Build menu).

2. To open a System Task, double-click a System Task workflow or workflow group in the Configurations pane.

Open

System Task workflows list

Modifying a System Task Workflow Configuration

All System Task Workflow configurations are modified at the template level. However, all workflow properties are set to Final and cannot be modified.

You can modify a System Task configuration, including its scheduling criteria, but you cannot create or remove a System Task configuration.

In the Archive Cleaner Workflow, you are only allowed to modify its scheduling criteria. For further information, see Scheduling in Managing a Workflow Group.  

  To Modify a System Task Workflow:  

1. Open the System Task Workflow that you want to modify. You can double-click or right-click on the System Task in the View Configuration.

2. Double-click the agent icon to open the Agent Configuration dialog.

3. Perform the changes and click OK.

4. Save the workflow.

Archive Cleaner

The Archive Cleaner System Task enables the removal of old archived files from the file system. The Archive Cleaner operates according to data that it receives from the Archive profiles.

Configuration Cleaner

The Configuration Cleaner enables the setting of maximum age of an old configuration before it is removed.

To configure the Configuration Cleaner:

1.   Select a configuration type from the table and click the entry in the Keep column to prompt the drop-down list.

2.   Select one of the following options: Always, Days, or Versions.
   
   

   Open

   

   The Configuration Cleaner System Task

Data Veracity Maintenance

The Data Veracity Maintenance system task removes outdated Data Veracity data. This task is only applicable to data in REPROCESSED or DELETE_APPROVED state. For more information, see Data Veracity (4.3).

ECS Maintenance

The ECS Maintenance enables the removal of old ECS data from the file system. This task is only applicable to data in the REPROCESSED state. For more information see ECS Maintenance System Task(4.3).

Statistics Cleaner

 The Statistics Cleaner enables the removal of old statistics data that has been collected by the Statistics server and stored in the database.

System Backup

The System Backup enables you to create a backup of all the configurations in the system. A backup file is saved on the host machine where the Platform application is installed. 

The System Backup files are stored in $MZ_HOME/backup/yyyy_MM, where yyyy_MM is translated to the current year and month, and $MZ_HOME/backup is the default path. The system saves a backup file and names it according to the following format: backup_<date>.zip. In addition, System Backup lets you specify the maximum age of backup files before they are removed. You can change this location using the following command:

The System Backup configuration dialog contains two tabs:

• System Backup: This is to enable the backup option.

• Cleanup: This is to configure the time during which a backup should be kept on the disk before it is deleted.

System Backup Tab

Cleanup Tab

System Log Cleaner

The System Log Cleaner deletes the System Log periodically. You specify how long to keep different message types in the System Log Cleaner configuration.

User Cleanup

The User Cleanup Task can be used to automatically deleting inactive users. If SSO is turned on, a user logged in through SSO is added in the system upon login, but the user is not removed when it is deleted from the OIDC server. To resolve this, the User Cleanup Task can be used to delete users that have not logged in for a configurable number of days.