Data aggregator - Inspect tab
- Felicity Borrelli
- Jenni Wallin
Â
The Inspect tab in the Data aggregator function allows you to manage individual aggregation sessions, including viewing, inspecting, and deleting them. There are a few ways to access the Inspect tab, via the Data aggregator function as documented beelow, and via the Aggregation tab, see Aggregation tab for more details.
Note!
The Inspect tab of the Data aggregator function is only accessible after the stream has been executed at least once.
To open the Inspect tab, double-click the Data aggregator function icon from the stream editor canvas, then click on the Inspect tab at the top right of the page.
Widgets
The widgets provide a snapshot of the number of active sessions, the oldest ongoing session, and the most recently initiated session. You can hide the widgets by going to Display options and switching off the Overview widgets toggle.
Inspect tab table
The table on the Inspect tab displays the data related to the sessions.
Actions on the Inspect tab table
Under More you have the following options:
Action | Description |
|---|---|
 View | Shows you the state of an aggregation session. You can copy the data if required. Example - Aggregated session data in JSON format This is an example of a JSON file sent downstream after a flush. {
"timeoutAt": "2024-10-02T14:19:48.108Z",
"createdAt": "2024-10-02T13:19:48.108Z",
"sum_fieldX": 52,
"group_fieldsA": 105,
"month_timestamp": "2024-09"
}"timeoutAt": "2024-10-02T14:19:48.108Z" This indicates the exact time when the system flushed the aggregated data. The data was flushed (sent downstream or processed further) based on a timeout at this specific timestamp. "createdAt": "2024-10-02T13:19:48.108Z" This marks the start time of the aggregation session, showing when the session was created. It indicates that this session ran for exactly one hour before the timeout occurred and the data was flushed. "sum_fieldX": 52 This shows that the aggregator has summed up the value in fieldX to 52 during this session. This could refer to any fields configured in the aggregated field section in the function’s configuration. "group_fieldsA": 105 This could be any field that has been used to group the data during aggregation. It can be set by selecting fields in Group fields in the function's configuration. "month_timestamp": "2024-09" This field represents the aggregation period. this is based on the date/time configured in Group fields in the aggregator function’s configuration. Note! These metadata fields can be used when creating custom scripts for aggregated data. See, Metadata, at the bottom of this page for more details. |
Edit Timeout | Edit the timeout date and time on a session before a session is flushed. This allows you to change when a timeout will happen before a session gets flushed. |
Delete | Delete the session. A warning message and confirmation dialogue will pop up. |
Â
Toolbar buttons
Filter panel
Click on the Filter button to open the Filter panel.
You can filter the aggregated sessions based on the following:
Setting | Description |
|---|---|
Session creation | Select from the dropdown list or select Custom and enter the from and to dates and times. |
Planned timeout | Select from the dropdown list or select Custom and enter the from and to dates and times. |
Fields | Use this option to filter by the Field and Value of a specific attribute. For example, after selecting the Field, you can choose an Operator like Less than, Greater than, Equal to, or you can filter according to Range of values or Is not equal to. In the Script Aggregator Inspect tab filter, you also can select the type of the field (String, Numerical or Boolean). |
Display options panel
Click on the Display options button to open the Display options panel.
Here you can enable or disable the Overview widgets and select which columns to display in the data table.
Refresh data
Click on this button to update and view the most current state of the aggregation sessions or data being displayed.
Metadata
There may be instances where you want to apply certain rules to aggregated data, such as applying a discount or adjusting values based on specific business rules. You can achieve this by using the Script function. If you need to reference metadata from aggregated sessions, such as the number of records or timestamps, you can access it using the meta-variable as described in Supported Variables/APIs.
Property | Description |
|---|---|
origin | This indicates that the data comes from the Data Aggregator component of the stream |
count | Number of aggregated records |
flushType | The reason for the session being flushed out. Shows any of the values: ALL_FILES, EACH_FILE, TIMEOUT, and CONDITION. During preview, the value will be empty. |
firstEvent | Date and time of the first aggregated record in the session |
lastEvent | Date and time of the last aggregated record in the session |
Â