This section describes the Kafka agents. The agents are used to forward and collect messages using Kafka. Kafka is a cluster-based software that can either be executed embedded in  or externally outside of the system.Kafka uses a high throughput publish-subscriber messaging model. It persists all messages and by design it decouples the publisher from the subscriber. That means that the forwarding agent will keep writing to the log even if the collection agents terminate.

The Kafka forwarding agent is listed among the processing agents in Desktop while the Kafka collection agent is listed among the collection agents.

Prerequisites

The reader of this document should be familiar with:

• Apache Kafka

  Note!

  A working knowledge of Apache Kafka is required. For further information, see http://kafka.apache.org.

This section includes the following subsections:

• 9.48.1 Kafka Agents Preparations
• 9.48.2 Kafka Agents Overview
• 9.48.3 Kafka Profile
• 9.48.4 Kafka Forwarding Agent
• 9.48.5 Kafka Batch Collection Agent
• 9.48.6 Kafka Real-time Collection Agent
• 9.48.7 Kafka UDR Types