Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Curabitur accumsan malesuada leo sed fermentum. Nullam non vehicula ligula, ut facilisis nisl. Curabitur at iaculis nisl, sit amet luctus justo. Cras hendrerit quam orci, eget consectetur eros congue eu. Aliquam pulvinar tempor mi, quis efficitur quam cursus a. The Agents function in the same way as their original counterparts with a few small differences, the main one being that the automatic batch scale agents have a new storage

The Batch Scaling feature in PE consists of the following new agents:

  • File Agent (Collection).

  • Inter-WF Agents (Collection and Forwarding).

  • Duplicate UDR Detection Agent.

  • Aggregation Agent.

The current documents for each of these agents are linked below.

These agents differ from their corresponding “standard” agents:

...

The transactions are stored in Kafka.

...

The backend working storage is Kafka.

...

A batch scaling solution requires you to use a combination of new agents and some existing agents that have had configuration setting updates. The key things to note are:

  • All storage related to the new agents is in Kafka. This includes transactions and backend working storage.

  • Workflows containing these new agents can be scaled without any configuration changes. The system handles will automatically handle the re-balancing of which workflow works against workflows use which partition.

Note!

  • You cannot mix standard Inter WF agents with scaling Inter WF agents in the same workflow.

...

  • This is because workflows with standard Inter WF agents save the state in

...

  • Usage Engine and workflows with batch agents save the state in Kafka.

Key agents used in scalable workflows

Agent Name

Description

Scalable Inter WF Collection Agent

Scalable_IW_Collection_agent_icon.pngImage Added

This is a newly created agent specifically for batch scaling workflows. It functions similarly and has the same configuration as the standard Inter Workflow Collection Agent.

Scalable Inter WF Forwarding Agent

Scalable_IW_Forwarding_agent_icon.pngImage Added

This is a newly created agent specifically for batch scaling workflows. It functions similarly and has the same configuration as the standard Inter Workflow Forwarding Agent.

Aggregation Agent

Aggregation_agent_icon.pngImage Added

A new Kafka storage option has been added to the existing Aggregation Agent. When setting up your batch scaling solution, you must add this storage option to the agent configuration, see Storage Tab in https://infozone.atlassian.net/wiki/x/chwcEg.

Duplicate UDR Agent

du_udr_agent_icon.pngImage Added

A new Kafka storage option has been added to the existing Duplicate UDR Agent. When setting up your batch scaling solution, you must add this storage option in the agent configuration. See Storage Tab in https://infozone.atlassian.net/wiki/x/yYkkEg.

Subsections

This section contains the following subsections:

Child pages (Children Display)
depth1
allChildrentrue
style
sortAndReverse
first0