Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 48 Current »

Term or AcronymDefinition

Batch stream

A stream processing high volumes of data in batch(es) within a specific time span. It processes large amount of records in one transaction. For example, data file read via S3 bucket.

For batch streams, the Glossary#flush happens only when a stream is run.

Bounded Stream

A unidirectional Glossary#stream that processes finite units of input, for example, complete files or a fixed amount of rows in a database.

Collector

A function that collects data from a Glossary#source.

Collection

The process of Cloud Edition acquiring data from a Glossary#source.

Client Mode

A communication mode where collectors initiate outgoing requests.

Custom References

Custom references refer to an optional feature that is used with SAP-related functions. When enabled it allows users to specify one or more typeCode and id values in the relevant usage records. 

Decode


The process of parsing input from a Glossary#source and converting it into records in a format that can be sent across a Glossary#route.

Destination


An endpoint to which data is sent from a Glossary#stream.

Encode

The process of formatting a record into a format that can be understood by a Glossary#destination.

Endpoint

An interface used by the service to connect to an Glossary#asset. An endpoint may function in either server mode or client mode.

Flush

The flush operation forces to pass the stored/buffered (aggregated) data to the next function in the stream.

Forwarder

A Function that sends data to a given Glossary#destination.

Forwarding

The process of sending data to a Glossary#destination.

Function

A Function accepts input, applies logic to it, and then returns a result. Functions may be stateful.

HTTP Response Headers

This is an option found within the HTTP Client collector and processor function, intended to support the sending out of response headers in the network stream. The users can enter a custom value in the result header key and associated result key to configure the target web service. 

Notification Group

 A notification group is an email list to which automated messages regarding erroneous events related to streams are being sent. The content of the error messages include stream execution errors, missing files, and related events. 

Payload

Refers to the current record.

Record

A unit of data that can be processed by a Function or multiple functions and sent across routes.

RegEx (Regular Expression)

The use of regular expressions implies the creation of custom schemes to which various operations can be executed. 

Real-time stream

Stream processing data in real-time. The data size is unknown, infinite and continuous. During real-time streams, the data output rate is as fast as data input rate. When the incoming data is continuous and requires immediate response then in that case real-time streams are used. For example, data continuously send via HTTP collector.

For real-time streams, the Glossary#flush happens after every 60 seconds. 

Route

A route is a link between two functions, across which data flows.

Session

A representation of aggregated records that is stored before being flushed out. 

Solution

A solution is a set of streams that together solve a particular customer problem.

Source


An Glossary#endpoint from which data is collected into a Glossary#stream using a given protocol and data format.

Stream

A graph representation of data flowing from a Glossary#source, through a series of functions, to a Glossary#destination

Time To Leave (TTL) 

This is a mechanism that limits the lifespan of data in an environment. It is used in functions like aggregation to express the date and time where a record expires. 

Timeout

A method that allows to set a timer to the execution of a certain function. Timeouts allow for more efficient usage of limited resources. The basic idea is that in situations where a system must wait for something to happen, rather than waiting indefinitely, the waiting will be aborted after the timeout period has elapsed.
Transaction

A transaction is a unit of data that is being processed inside a stream. The definition of a completed transaction is when the stream processes it without any errors. The transactions by design are limited to their specified data sources.

A transaction can refer to a file that is being processed in a stream or a result set from a query. 

The data correction feature also creates transactions of reference and they are regarded as separate processes. 

For more information refer to Transaction Safety.

Transactions Per Second (TPS)

This is a metric showing the number of transactions per second (tps) that can be processed by a given web service. This value can be calculated using this formula:

Tps value for a function = (Total number of output events handled by the function) / (duration of the stream)

  • No labels