New profile that will be created is the Scalable inter-workflow profile.
Several new agents have been created for the automatic batch scaling feature. The new agents function mostly in the same way as the original agents and the same documentation is still applicable. There are however some minor differences that are important to understand:
All storage related to the new agents is in Kafka. This includes transactions and backend working storage.
Workflows containing these new agents can be scaled without any configuration changes. The system will automatically handle the re-balancing of which workflows use which partition.
The following new Agents have been created for the automatic batch scaling feature. See the links to the original Agent documentation for more details.
Scalable Inter Workflow Forwarding Agent, see https://infozone.atlassian.net/wiki/x/MxgkEg diff agents but same config with MIMs
Scalable Inter Workflow Collection Agent, seehttps://infozone.atlassian.net/wiki/x/BhkkEg slightly diff - just missing a few items.
These will be the same agents used except they will require that the storage be configured to Kafka. Some use cases may need to switch to the new profile.Duplicate UD Agents, see https://infozone.atlassian.net/wiki/x/uokkEg
Aggregation Agent, see https://infozone.atlassian.net/wiki/x/XxwcEg
The Batch Scaling feature in PE consists of the following new agents:
File Agent (Collection).
Inter-WF Agents (Collection and Forwarding).
Duplicate UDR Detection Agent.
Aggregation Agent.
Note!
You cannot mix standard agents with scaling agents in the same workflow. Workflows with standard agents save the state in PE. Workflows with batch agents save the state in Kafka.