Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Private_Edition_flag.png

Excerpt
namePartition Profile explanation (4.3)

The Partition profile has been created as part of the batch scaling solution. In the Partition Profile configuration, you define the Max Scale Factor and one or more fields that will be used to determine the key for partitioning.

Configuration

To create a new Scalable Partition profile configuration, click New Configuration and select Partition Profile from the Configurations dialog.

The profile configuration contains two tabs; General and Association.

Parameter

Comment

ID Field

Defines how to match a UDR to a partition.

Max Scale Factor - this is located in the Partition profile config.

Number of partitions, which is the same as maximum number of workflows that can execute in parallel. - this means that there can be fewer workflows - but not more.

Note!

If any of the parameters need to be changed, it is considered a new configuration, and they need to start with empty topics.

General tab

The General tab is displayed by default when creating or opening the Partition Profile. This is where you define the Max Scale Factor; the maximum number of partitions to be created within your batch scaling solution.

prtition_profile_general_tab.png
Tip

Hint!

When setting the Max Scale Factor, you are defining the number of partitions, which determines the level of parallelism you can achieve. While you should choose a number large enough to handle expected workloads, avoid going too big, as excessively high numbers can strain system resources or lead to inefficiencies if the data isn’t evenly distributed. A good approach is to select a Max Scale Factor that is divisible by many numbers, as this allows for a more balanced distribution of workloads across workflows. For example, numbers like 6, 12, or 30 work well because they can be evenly divided by a wide range of values.

Association Tab

In the Association tab, (not to match but to check and create a key based on the fields that are input) configure rules that are used to match an incoming UDR with a session. Every UDR type requires a set of rules that are processed in a certain order. In most cases, only one rule per incoming UDR type is defined.

You can use a primary expression to filter out UDRs that are candidates for a specific rule. If the UDR is filtered out by the primary expression, it is matched with the existing sessions by using one or several ID fields as a key.

For UDRs with ID Fields matching an existing session, an additional expression may be used to specify additional matching criteria. For example, if dynamic IP addresses are provided to customers based on time intervals, the field that contains the IP address could be used in ID Fields while the actual time could be compared in Additional Expressionadd one or more ID Fields that you want to use to create the key for partitioning the data within your scalable solution, for example….

partition_profile_association_tab.png