New Features and Functionality (3.0)
In this section you can see information about the new features and functionality in this release.
Workflow Controlled ECD Scheduling
Issue number(s): XE-7553
When creating or editing an ECD, you can now select the option Enable on Schedule which will make the ECD follow the scheduling in the workflow groups contained in the ECD. This will allow the ECD to automatically be disabled when not needed, which will free up resources.
The option can be enabled either in the web interface:
or by using the following kubectl command:
|
and then set enableOnSchedule
to true
or false
in the spec: section.
|
See Creating an EC Deployment(3.0) for more information.
For more information, see .
Session Iterator Functions
Issue number(s): XE-6660
Four different APL sessionIterator functions are introduced to enable search through the sessions in the aggregation storage. This allows for automatic reports and searches instead of manually using the Aggregation Session Inspector in Desktop.
- sessionIteratorCreate
- sessessionIteratorNext
- sessionIteratorErrorCount
- sessionIteratorDestroy
For more information, see Session Iterator Functions(3.0).
Excel Processing Agents
Issue number(s): XE-1423
The Excel agents convert Excel files into UDRs to be routed into a workflow, and then converts the UDRs back into an Excel file to be delivered to the output destination. These are processing agents for batch workflow configurations.
Excel Workflow
For more information, see Excel Agents(3.0).
MQTT Collection Agent
Issue number(s): XE-4678
The MQTT collection agent is available for real-time workflows.Â
The MQTT (MQ Telemetry Transport) agent enables you to act as a publisher or subscriber of a transport messaging protocol that runs on TCP/IP.
The MQTT agent has several different UDRs which are used for publishing and subscribing messages. The agent supports multiple brokers and connection over TLS if required.
MQTT Workflow
For more information, see MQTT(3.0).
AMQP Collection Agent
Issue number(s): XE-7119
The AMQP collection agent is available for real-time workflows.
The AMQP (Advanced Message Queueing Protocol) agent enables you to act as an AMQP client communicating with AMQP.Â
The AMQP agent has several different UDRs which are used for publishing and subscribing for messages. The agent supports multiple brokers and connection over TLS if required.
Example workflows for AMQP as subscriber and publisher
For more information, see AMQP(3.0).
Elasticsearch Storage Available for Aggregation
Issue number(s): XE-2600
An Elasticsearch profile, verified with Elasticsearch version 6.0, is now available for use with Aggregation.
An Elasticsearch profile is used to read and write data in an Elasticsearch Service in AWS and can be accessed by batch workflows using Aggregation agents. Elasticsearch is supported to provide a scalable distributed storage option. It is a search and analytics engine that provides high scalability on a cloud infrastructure with cluster scaling options and replication across several domains, and the capacity to query large amounts of data.
    Â
Elasticsearch Profile - Connectivity tab
Â
Elasticsearch Profile - Advanced tab
For more information, see Elasticsearch (3.0).
Parquet Agents
Issue number(s): XE-7517
The Parquet agents are used to handle data encoded and compressed with Apache Parquet. The Parquet Decoder Agent converts rows from Parquet documents into UDRs to be routed into Usage Engine workflows. The Parquet Encoder Agent converts UDRs into Parquet format to be delivered to output destinations. The Parquet agents are only available for batch workflow configurations.
Example workflow with Parquet Decoder and Parquet Encoder agents
For more information, see Parquet(3.0).
Encryption Agent
Issue number(s): XE-7246
The Encryption agent is a processing agent for batch and real-time workflow configurations.Â
The Encryption agent can be used to either mask or unmask files for data protection purposes. It can be used when data is going to be processed in the cloud instances. The agent enables compliance with data protection regulations, ensuring personal data is accessed accordingly.
The agent uses a profile in which you can make your encryption configurations, see Encryption Profile for further information about this profile.
In the agent, you can determine whether the agent should encrypt or decrypt files and if you want the agent to handle empty data or not.
See Encryption for more information.
PKCS7 Functions Support
Issue number(s): XE-7247
PKCS7 functions support the signing of data using CMS signature.Â
See PKCS7 Functions for more information.
Data Masking Agent
Issue number(s): XE-2601
The Data Masking agent is a processing agent for batch and real-time workflow configurations.Â
The Data Masking agent can be used to either mask or unmask specified fields in different UDRs in order to protect the data. It can be used when data is going to be processed in the cloud without involving personal data, for example. The agent enables compliance with regulations around data protection, ensuring personal data is accessed in a controlled manner.
The agent uses a profile in which you can define the masking method; Crypto, Database, or Hash, as well as which fields to mask/unmask along with additional settings specific for each masking method. When selecting Database, Oracle, Postgres, and SAP HANA can be used.
See Data Masking for more information.
Firebase Agent
Issue number(s): XE-1442
The Firebase agent is available for real-time workflows.
The Firebase agent allows you to send notifications to mobile devices via Firebase Cloud Messaging.
There are two UDR types specific for the APN agent;Â FirebaseUDR
 and FirebaseErrorUDR
.
Firebase Workflow
For more information, see Firebase(3.0).
Kafka 3 Support
Issue number(s): XE-7901
Kafka 3 is now supported. For more information, see Optional Software(3.0).
Data Veracity Supports PostgreSQL 15
Issue number(s): XE-7520
Data Veracity now supports the use of PostgreSQL 15.Â
The Data Veracity profile has now been updated to generate SQL scripts for creating Data Veracity tables in PostgreSQL and the web UI now runs the support.
Data Veracity performance tuning tips has also been updated to include suggestions on how to index the fields in PostgreSQL.
For more information, see Data Veracity(3.0).
HTTP Batch Agent
Issue number(s): XE-5959
HTTP Batch agent is a collection agent that collects files from a HTTP or HTTPS url as a byte stream. Using a workflow, you can then output the streams into a file.Â
HTTP Batch Agent - Connection Tab with HTTP url defined.
For more information, see HTTP Batch(3.0).
Deploying DTK MZP:s Through Helm
Issue number(s): XE-7601
It is now possible to drive deployment of DTK mzp:s through the helm chart, see the dtk
values in the Helm chart for details.
Azure Keyvault
Issue number(s): XE-7769
 now supports Azure keyvault cloud service to securely store secrets. To be able to use Azure keyvault, Security Profile, Secrets Profile and SAP RFC Profile are also extended to use this service. See Azure KeyVault (3.0) for more information.
Authentication Method - Secret keyÂ
Authentication Method- Certificate