Kafka

The Apache Kafka framework uses a high-throughput, distributed, publish-subscribe messaging model. The framework is scalable and it can be elastically and transparently expanded without downtime. Data streams are partitioned and spread over a cluster of machines to allow data streams larger than the capability of a single machine and to allow clusters of coordinated consumers.

...

• There is a need to connect real-time workflows that are running on the same, or in different, MediationZone installations.
• Minimization of data loss is prioritized.
• One-way communication is sufficient (one-to-one or one-to-many).

Workflow Bridge

A Workflow Bridge agent acts as a bridge for communication between real-time workflows, or between batch and real-time workflows, within the same MediationZone system. There are several benefits of using Workflow Bridge:

...

Batch to real-time Workflow Bridge

Communication

The Workflow Bridge agents communicate with each other using a dedicated set of UDRs. Communication is done in-memory when workflows are executing within the same Execution Context. TCP or Aeron are used when the workflows are running on different Execution Contexts. This provides for efficient transfer of data.

...