| Excerpt | ||
|---|---|---|
| ||
The Partition profile has been created as part of the batch scaling solution. In the Partition Profile configuration, you define the Max Scale Factor and one or more fields that will be used to determine the key for partitioning. ConfigurationTo create a new Scalable Partition profile configuration, click New Configuration and select Partition Profile from the Configurations dialog. The profile configuration contains two tabs; General and Association. | ||
Parameter | Comment | |
ID Field | Defines how to match a UDR to a partition. | |
Max Scale Factor - this is located in the Partition profile config. | Number of partitions, which is the same as maximum number of workflows that can execute in parallel. - this means that there can be fewer workflows - but not more. Note! If any of the parameters need to be changed, it is considered a new configuration, and they need to start with empty topics. |
| Tip |
|---|
Hint! When setting the Max Scale Factor, you are defining the number of partitions, which determines the level of parallelism you can achieve. While you should choose a number large enough to handle expected workloads, avoid going too big, as excessively high numbers can strain system resources or lead to inefficiencies if the data isn’t evenly distributed. A good approach is to select a Max Scale Factor that is divisible by many numbers, as this allows for a more balanced distribution of workloads across workflows. For example, numbers like 6, 12, or 30 work well because they can be evenly divided by a wide range of values. |
Association Tab
In the Association tab, you define how to assign UDRs to partitions using ID fields. If you add one or more ID Fields that you want to use to create the key for partitioning the data within your scalable solution, for example…fields, these will be used as the partitioning key. If you leave the ID fields empty, partitions will be assigned round-robin.
