| Excerpt | ||
|---|---|---|
| ||
The Partition profile has been created as part of the batch scaling solution. In the Partition Profile configuration, you define the Max Scale Factor and one or more fields that will be used to determine the key for partitioning.
Configuration
To create a new Scalable Partition profile configuration, click New Configuration and select Partition Profile from the Configurations dialog.
The profile configuration contains two tabs; General and Association.
Parameter
Comment
ID Field
Defines how to match a UDR to a partition.
Max Scale Factor - this is located in the Partition profile config.
Number of partitions, which is the same as maximum number of workflows that can execute in parallel. - this means that there can be fewer workflows - but not more.
Note!
If any of the parameters need to be changed, it is considered a new configuration, and they need to start with empty topics.
General tab
The The General tab tab is displayed open by default when creating you create or opening access the Partition Profile. This is where you define Here, you set the Max Scale Factor; , which determines the maximum number of partitions to that can be created within in your batch scaling solution. This value also limits the maximum number of workflows that can run in parallel—fewer workflows can run, but not more.
...
| Tip |
|---|
Hint! When setting the Max Scale Factor, you are defining the number of partitions, which determines the level of parallelism you can achieve. While you should choose a number large enough to handle expected workloads, avoid going too big, as excessively high numbers can strain system resources or lead to inefficiencies if the data isn’t evenly distributed. A good approach is to select a Max Scale Factor that is divisible by many numbers, as this allows for a more balanced distribution of workloads across workflows. For example, numbers like 6, 12, or 30 work well because they can be evenly divided by a wide range of values. |
Association Tab
In the Association tab, add you define how to match a UDR to a partition by adding one or more ID Fields that you want to use in the configuration. These fields will be used to create the key for partitioning the data within your scalable solution, for example….
...