Workflow Types Description

Owned by Jenni Wallin
Feb 24, 2023
2 min read

There are three different types of workflows: batch, real-time and tasks. Each have a slightly different execution behavior, but their modelling and configuration structure is the same. 

Batch Workflows

Batch workflows are used to collect process and distribute file-based data, also referred to as an offline model. These workflows can be configured for multi-threaded execution, enforcing a first-in-first-out processing order, and a strict transaction boundary based on each batch processed. Batch workflows are transaction safe as data processing can be rolled back and reprocessed if required. 

Batch workflow

Realtime Workflow 

Real-time workflows enable online processing of requests/answers with other systems. These workflows enable execution of large numbers of independent execution paths simultaneously using a multi-threading execution model. 

Realtime workflow

Task Workflow 

Task workflows are used to execute common activities such as test, cleanup or maintenance tasks. A number of System Tasks are pre-configured in Usage Engine and can be complemented with any user-defined activity. These user defined tasks are scheduled and executed through Task Workflows, using one of the following agents: 
 

  • Data Veracity – Used for repairing/altering UDRs sent to the error storage Data Veracity.  
  • Python – Executes Python script. 
  • SQL – Executes SQL statements or scripts. 
  • Script – Runs a shell script or other executable. 
  • Unit Test Runner – Executes unit tests (Python scripts).  

Task workflow