Building a stream

Building a stream

CE.png

To build your stream, add and connect the functions needed to process your data as required. Every stream must include at least one collector, processor, and forwarder function.

Add functions to the canvas

Add functions by dragging them from the Function library onto the canvas. To configure a function, double-click it or right-click and select Edit to open the Function editor. Once configured, you can link functions by connecting their endpoints.

For a guide to creating streams, see: My first stream

Stream elements in the UI

Each function has circular inputs and outputs that look like this: Edge_icon.png

The lines that connect function outputs to function inputs are called links. Links define how data flows between functions in the stream.

A single stream can contain up to 125 functions and 150 links. If you reach these limits, you must remove existing functions or links before adding new ones.

  • Collector functions (for example, Count) have only outputs, because they receive data from an external system and forward it to processor functions.

  • Processor functions (for example, Date) have at least one input and one output. They receive data from a previous function and then forward it to one or more subsequent functions, so they may have multiple outputs depending on the configuration.

  • Forwarder functions (for example, https://infozone.atlassian.net/wiki/x/9P53) have only inputs, because they terminate the stream by sending data to an external system.

StreamEdges.png
A complete stream showing connectors, function input, and outputs

Note!
In the JSON import/export and backend APIs, a function is referred to as a node, and a link is referred to as an edge. The stream nodes and edges form a Directed Acyclic Graph.

Edit vs View mode

The Stream editor offers two modes: Edit and View. When you create a new stream, the editor opens in Edit mode. For existing streams, it opens in View mode, and the function library is hidden. You can switch between modes using the View and Edit buttons in the toolbar.

Return to Solution page

To return to the Solution page and view the streams in your solution, click the arrow next to the stream name.

StreamnameArrow.png
Arrow next to stream name