Stream audit

Introduction

Stream audit data is available once the stream processing is complete, and you can view it in the Stream audit tab in the Audit page. If you have an unbounded stream, which is a stream with a running HTTP server that keeps on processing or waiting for new requests until manually stopped, you need to stop the stream to view the metrics.

This audit data is unavailable if the target stream has failed to run or has been aborted. 

To open the Stream audit tab, you can either click on the More menu in the Action column in the Stream tab, and select Audit and then click the Stream audit tab, or you can open the stream in the Stream editor, click on the View audit button, and then click on the Stream audit tab.

stream-audit.png
Stream audit tab

The stream audit information is displayed in a table with the following columns:

Column

Description

Column

Description

Start time

Date and timestamp when the first transaction in a stream is started.

End time

Date and timestamp when the last transaction operation has ended.

Total input

The total number of events processed by the collector Functions in the stream.

Total output

The total number of events processed by the forwarder Functions in the stream.

Processing time

The total processing time of the stream.

The total time, which is the time between Start time and End time, will always be slightly higher than the Processing time since there is a short gap in time between each transaction, and the total time considers this gap.

The Processing time is the time it took to process the data and is also used for calculating the transactions per second (tps) metric.

Click on the plus sign in front of a stream record to view more details.

In the table displayed you can see the following information:

Column

Description

Column

Description

Function name

Name of the Function

Function type

Type of the Function

Inputs

Total number of incoming events processed by the Function

Outputs

Total number of outgoing events processed by the Function

TPS

The number of transactions handled per second.

The TPS is calculated as:

TPS value for a Function = (Total number of output events handled by the Function) / (duration of the stream)

It may take a few seconds for the metrics to load in the metrics view. Click Refresh or go back to the metrics page after some time. 

The metrics are stored for 30 days.