In this section you can see information about the new features and functionality in this release.

Workflow Controlled ECD Scheduling

Issue number(s): XE-7553

When creating or editing an ECD, you can now select the option Enable on Schedule which will make the ECD follow the scheduling in the workflow groups contained in the ECD. This will allow the ECD to automatically be disabled when not needed, which will free up resources.

The option can be enabled either in the web interface:

or by using the following kubectl command:

and then set enableOnSchedule to true or false in the spec: section.

See Creating an EC Deployment[hide]3.0[/hide] for more information.

Session Iterator Functions

Issue number(s): XE-6660

Four different APL sessionIterator functions are introduced to enable search through the sessions in the aggregation storage. This allows for automatic reports and searches instead of manually using the Aggregation Session Inspector in Desktop.

• sessionIteratorCreate
• sessessionIteratorNext
• sessionIteratorErrorCount
• sessionIteratorDestroy

For more information, see Session Iterator Functions.

Excel Processing Agents

Issue number(s): XE-1423

The Excel agents convert Excel files into UDRs to be routed into a workflow, and then converts the UDRs back into an Excel file to be delivered to the output destination. These are processing agents for batch workflow configurations.

Excel Workflow

For more information, see Excel Agents.

MQTT Collection Agent

Issue number(s): XE-4678

The MQTT collection agent is available for real-time workflows. 

The MQTT (MQ Telemetry Transport) agent enables you to act as a publisher or subscriber of a transport messaging protocol that runs on TCP/IP.

The MQTT agent has several different UDRs which are used for publishing and subscribing messages. The agent supports multiple brokers and connection over TLS if required.

MQTT Workflow

For more information, see MQTT.

AMQP Collection Agent

Issue number(s): XE-7119

The AMQP collection agent is available for real-time workflows.

The AMQP (Advanced Message Queueing Protocol) agent enables you to act as an AMQP client communicating with AMQP. 

The AMQP agent has several different UDRs which are used for publishing and subscribing for messages. The agent supports multiple brokers and connection over TLS if required.

Example workflows for AMQP as subscriber and publisher

For more information, see AMQP.

Elasticsearch Storage Available for Aggregation

Issue number(s): XE-2600

An Elasticsearch profile, verified with Elasticsearch version 6.0, is now available for use with Aggregation.

An Elasticsearch profile is used to read and write data in an Elasticsearch Service in AWS and can be accessed by batch workflows using Aggregation agents. Elasticsearch is supported to provide a scalable distributed storage option. It is a search and analytics engine that provides high scalability on a cloud infrastructure with cluster scaling options and replication across several domains, and the capacity to query large amounts of data.

Elasticsearch Profile - Connectivity tab

Elasticsearch Profile - Advanced tab

For more information, see Elasticsearch Profile.

Parquet Agents

Issue number(s): XE-7517

The Parquet agents are used to handle data encoded and compressed with Apache Parquet. The Parquet Decoder Agent converts rows from Parquet documents into UDRs to be routed into Usage Engine workflows. The Parquet Encoder Agent converts UDRs into Parquet format to be delivered to output destinations. The Parquet agents are only available for batch workflow configurations.

Example workflow with Parquet Decoder and Parquet Encoder agents

For more information, see Parquet.

Encryption Agent

Issue number(s): XE-7246

The Encryption agent is a processing agent for batch and real-time workflow configurations. 

The Encryption agent can be used to either mask or unmask files for data protection purposes. It can be used when data is going to be processed in the cloud instances. The agent enables compliance with data protection regulations, ensuring personal data is accessed accordingly.

The agent uses a profile in which you can make your encryption configurations, see Encryption Profile for further information about this profile.

In the agent, you can determine whether the agent should encrypt or decrypt files and if you want the agent to handle empty data or not.

See Encryption for more information.

PKCS7 Functions Support

Issue number(s): XE-7247

PKCS7 functions support the signing of data using CMS signature. 

See PKCS7 Functions for more information.

Data Masking Agent

Issue number(s): XE-2601

The Data Masking agent is a processing agent for batch and real-time workflow configurations. 

The Data Masking agent can be used to either mask or unmask specified fields in different UDRs in order to protect the data. It can be used when data is going to be processed in the cloud without involving personal data, for example. The agent enables compliance with regulations around data protection, ensuring personal data is accessed in a controlled manner.

The agent uses a profile in which you can define the masking method; Crypto, Database, or Hash, as well as which fields to mask/unmask along with additional settings specific for each masking method. When selecting Database, Oracle, Postgres, and SAP HANA can be used.

See Data Masking for more information.

Firebase Agent

Issue number(s): XE-1442

The Firebase agent is available for real-time workflows.

The Firebase agent allows you to send notifications to mobile devices via Firebase Cloud Messaging.

There are two UDR types specific for the APN agent; FirebaseUDR and FirebaseErrorUDR.

Firebase Workflow

For more information, see Firebase.

Kafka 3 Support

Issue number(s): XE-7901

now supports Kafka 3. For more information, see Optional Software[hide]3.0[/hide].

Data Veracity Supports PostgreSQL 15

Issue number(s): XE-7520

Data Veracity now supports the use of PostgreSQL 15. 

The Data Veracity profile has now been updated to generate SQL scripts for creating Data Veracity tables in PostgreSQL and the web UI now runs the support.

Data Veracity performance tuning tips has also been updated to include suggestions on how to index the fields in PostgreSQL.

For more information, see Data Veracity[hide]3.0[/hide].

HTTP Batch Agent

Issue number(s): XE-5959

HTTP Batch agent is a collection agent that collects files from a HTTP or HTTPS url as a byte stream. Using a workflow, you can then output the streams into a file. 

HTTP Batch Agent - Connection Tab with HTTP url defined.

For more information, see HTTP Batch.

Deploying DTK MZP:s Through Helm

Issue number(s): XE-7601

It is now possible to drive deployment of DTK mzp:s through the helm chart, see the dtk values in the Helm chart for details.