Excerpt | ||
---|---|---|
| ||
The Partition profile has been created as part of the batch scaling solution. In the Partition Profile configuration, you define the Max Scale Factor and one or more fields that will be used to determine the key for partitioning. ConfigurationTo create a new Scalable Partition profile configuration, click New Configuration and select Partition Profile from the Configurations dialog. The profile configuration contains two tabs; General and Association. | ||
Parameter | Comment | |
ID Field | Defines how to match a UDR to a partition. | |
Max Scale Factor - this is located in the Partition profile config. | Number of partitions, which is the same as maximum number of workflows that can execute in parallel. - this means that there can be fewer workflows - but not more. Note! If any of the parameters need to be changed, it is considered a new configuration, and they need to start with empty topics. |
Tip |
---|
Hint! When setting the Max Scale Factor, you are defining the number of partitions, which determines the level of parallelism you can achieve. While you should choose a number large enough to handle expected workloads, avoid going too big, as excessively high numbers can strain system resources or lead to inefficiencies if the data isn’t evenly distributed. A good approach is to select a Max Scale Factor that is divisible by many numbers, as this allows for a more balanced distribution of workloads across workflows. For example, numbers like 6, 12, or 30 work well because they can be evenly divided by a wide range of values. |
Association Tab
In the Association tab, (not to match but to check and create a key based on the fields that are input) configure rules that are used to match an incoming UDR with a session. Every UDR type requires a set of rules that are processed in a certain order. In most cases, only one rule per incoming UDR type is defined.
You can use a primary expression to filter out UDRs that are candidates for a specific rule. If the UDR is filtered out by the primary expression, it is matched with the existing sessions by using one or several ID fields as a key.
For UDRs with ID Fields matching an existing session, an additional expression may be used to specify additional matching criteria. For example, if dynamic IP addresses are provided to customers based on time intervals, the field that contains the IP address could be used in ID Fields while the actual time could be compared in Additional Expressionyou define how to assign UDRs to partitions using ID fields. If you add one or more ID fields, these will be used as the partitioning key. If you leave the ID fields empty, partitions will be assigned round-robin.