New profile that will be created is the Scalable inter-workflow profile.
Several new agents have been created for the automatic batch scaling feature. The new agents function mostly in the same way as the original agents and the same documentation is still applicable. There are however some minor differences that are important to understandThe batch scaling solution requires you to use a combination of new agents and some existing agents that have had configuration setting updates. two key things to note are:
All storage related to the new agents is in Kafka. This includes transactions and backend working storage.
Workflows containing these new agents can be scaled without any configuration changes. The system will automatically handle the re-balancing of which workflows use which partition.
...
Agents used in scalable workflows
Agent name | Description |
|---|---|
Scalable Inter Workflow Forwarding Agent |
...
include image | This is a newly created agent specifically for batch scaling workflow groups.
|
Scalable Inter Workflow |
...
Forwarding Agent include image | This is a newly created agent specifically for batch scaling workflow groups.
|
File Collection Agent | |
Aggregation Agent | A new Kafka storage option has been added to the existing Aggregation Agent. When setting up your batch scaling solution you must add this storage option to the agent configuration. Some use cases may need to switch to the new profile. |
...
Duplicate UD Agents, see https://infozone.atlassian.net/wiki/x/uokkEg
...
Aggregation Agent, see https://infozone.atlassian.net/wiki/x/XxwcEg
The Batch Scaling feature in PE consists of the following new agents:
...
File Agent (Collection).
...
Inter-WF Agents (Collection and Forwarding).
...
Duplicate UDR Detection Agent.
...
See, Aggregation Agent(4.3). | |
Duplicate UDR Agent | A new Kafka storage option has been added to the existing Duplicate UDR Agent. When setting up your batch scaling solution you must add this storage option to the agent configuration. See Duplicate UDR(4.3). |
Subsections
This section contains the following subsections:
| Child pages (Children Display) | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|
Note!
You cannot mix standard InterWF agents with scaling InterWF agents in the same workflow. Workflows with standard Inter workflow agents save the state in PE. Workflows with batch agents save the state in Kafka.
...