04. Online Interface Agents MZ 9

Optional online interfaces for message based collection and distribution.

 OP = On-premise, CS= Cloud Service

General Availability

Package

Type

Included in Subscription base license

Rel.

Description

AMQP Collection



Online

Y

9.0.0.0

Collects messages from Rabbit Message Queues using the AMQ (Advanced Message Queueing) Protocol. A list of brokers to collect from can be configured for each agent. Optionally, TLS can be enabled.  

Reference:

APL plugin Kusto databasesBothY9.0.0.0

Enables database lookups in Kusto databases.

Diameter

Online

Y

6.0.0.0

The Diameter agents enable a workflow to act as a Diameter server, a Diameter client, or as a Diameter Proxy agent, by applying the Diameter Base Protocol. Supports TCP and SCTP as transport protocols over IPv4 and IPv6. Import and export of AVP and Command specifications supports two formats: ABNF (Augmented Backus-Naur Format) and XML (eXtensible Markup Language).

Reference:

Disk Collection Realtime



Online

Y

9.0.0.0

Continuously scans and collects files from local disk. Uses the Standard File Collection Functions and File Collection Functions Available for Realtime Only.
For transaction safety reasons, the collection agent needs to be followed by an Analysis or Aggregation agent, as each file received needs to be acknowledged with a reply to the collection agent.

Based on the Batch Disk Collection Agent. Please refer to that package for more information.

Disk Forwarding Realtime

Online

Y

9.0.0.0

Forwards files to local disk according to configured file closure criteria. 
Uses the Standard File Forwarding Functions and File Forwarding Functions Available for Realtime Only

Based on the Batch Disk Forwarding Agent. Please refer to that package for more information.

FTP Collection Realtime


OnlineY9.0.0.0

Continuously scans and collects files from remote file system using the standard FTP (RFC 959) protocol. Uses the Standard File Collection Functions and File Collection Functions Available for Realtime Only
For transaction safety reasons, the collection agent needs to be followed by an Analysis or Aggregation agent, as each file received needs to be acknowledged with a reply to the collection agent.

Based on the Batch FTP Collection Agent. Please refer to that package for more information.

FTP Forwarding RealtimeOnlineY9.0.0.0

Forwards files to remote file system using the standard FTP (RFC 959) protocol. Uses the Standard File Forwarding Functions and File Forwarding Functions Available for Realtime Only

Based on the Batch FTP Forwarding Agent. Please refer to that package for more information.

Firebase FCM Fwd

OnlineY9.0.0.0

Enables push notifications to be sent to mobile devices using Firebase Cloud Messaging. 

Reference:

GCP PubSubOnlineY9.0.0.0

Enables Google Cloud Platform integration. Consists of:

  • GCP PubSub Profile
  • GCP PubSub Subscriber agent
  • GCP PubSub Publisher agent
  • GCP BigQuery forwarding agent

GTP'

Online 

Y

9.0.0.0

Collects charging messages and datagrams from GSM agents (SGSN and GGSN) using the GPRS Tunneling protocol, via TCP or UDP. The agent can optionally check for duplicates and sequence numbers, and a configurable number of nodes to collect from can be defined. To assure that data is transmitted properly, a subsequent Analysis or Aggregation agent can be configured to send acknowledgement to the collection agent. 

References:

HTTP

Online

Y

9.0.0.0

The collection agent is based on the Batch HTTP Collection Agent. Please refer to that package for more information.

HTTP2 Client AgentOnlineY9.0.0.0

Enables a workflow to communicate requests to HTTP/2 servers. Supports both HTTP/1 and HTTP/2.

HTTP2 Server AgentOnlineY9.0.0.0

Enables a workflow to act as an HTTP/2 Server. Supports both HTTP/1 and HTTP/2.

References:

IBM MQ

Online

Y

9.0.0.0

Acts as a client to an IBM Websphere MQ Queue Manager. Collects messages from a configurable number of message queues, topics or durable subscriptions.

Reference:

IPDR/SPOnlineY9.2.0.0

The Internet Protocol Detail Record Streaming Protocol (IPDR SP) Agent collects data according to specifications:

JMS

Online

N

9.0.0.0


JMS 1.1 interface agents:

  • JMS Collector Agent; sets up a subscription session to a JMS server.
  • JMS Request Agent; sets up a publishing session to a JMS server.

The following JMS vendors are currently supported:

  • Weblogic
  • SonicMQ
  • ActiveMQ
  • JBossMQ
  • HornetQ
  • Solace

Kafka Agents

Online

9.0.0.0

Collection and Forwarding of Apache Kafka messages. 
Kafka Batch Collection Agent (Offline Agent).

LDAP AgentOnlineY9.0.0.0

A processing agent acting as a client to LDAP (Lightweight Directory Access Protocol ) Servers. A list of servers to connect to can be configured, in either round robin or failover mode. In additions to standard authentication using security credentials, TLS - with or without keys - can be enabled. Supported operations:

  • Abandon
  • Add
  • Compare
  • Delete
  • Extended Operation
  • Modify
  • ModifyDN
  • Search

Reference:

MQTT ClientOnlineY9.0.0.0

Collects data from MQTT (Message Queue Telemetry Transport) servers using the TCP/IP protocol. A list of brokers can be configured, as well as a list of topics to subscribe to. TLS can be enabled.

Reference:

MSMQ OnlineY9.0.0.0

Collection
Collects messages from an MSMQ (Microsoft Message Queuing) server.

Processing
Forwards messages to an MSMQ (Microsoft Message Queuing) server.

Reference:

Netflow

Online

Y

9.0.0.0

Collects traffic data from one or several Cisco routers.  Support Netflow versions 1, 5, 7, 8, 9, and 10. The agent binds on a specific port and IP address, and can be configured to only include predefined hosts. Routers using more than one interface IP address are configured to have a main IP address. Warnings on sequence gaps can be enabled.  

Reference:

Open API ProfileOnlineY9.0.0.0

The Profile enables definition of Open API specifications, that can be used with the HTTP/2 agents. Direct import from the UI is possible. Additional files defined by the specification will automatically be included.

Prometheus Forwarding AgentBothY9.0.0.0


Enables publishing of metrics in a format that can be scraped by a Prometheus instance. The Prometheus Filter UI allows configuration of which metrics to expose for scraping. 

This package replaces the System Insight package. Note that the Prometheus Agent can accept System Insight UDRs as input, making it easy to update System Insight workflows to Prometheus workflows.

Python ConnectorOnlineY9.0.0.0

Enables test and exploration of workflows using an external exploration tool, for instance Jupyter Notebook. Gives the exploration tool access to all the UDRs, routes, APL functions etc that are part of the workflow. Supports interactive mode.

Python Realtime CollectionOnlineY9.2.0.0

Collects data from Python real-time sources.

Python Realtime ProcessingOnlineY9.0.0.0

Enables processing using Python, as an alternative to APL. Includes the possibility to define several different interpreters and working directories using the Interpreter Profile.

REST Client AgentOnlineY9.0.0.0

The REST Client processing agent queries an HTTP API using any of the methods specified in the RFC 2616. If the REST API's schema is described in JSON or YAML files, the OpenAPI profile can be used to automatically generate UDR structures. 

Reference:

  • RFC 2616 - Hypertext Transfer Protocol -- HTTP/1.1
  • RFC 6749 - OAuth 2.0 Authorization Framework
    • NOTE! This specification defines four grant types for authentication. The currently available grant types for the agent are two - "Client Credentials" and "Resource Owner Password Credentials". 
  • RFC 7617 - Basic HTTP Authentication Scheme

REST Server AgentOnlineY9.0.0.0

The REST Server agent receives HTTP requests from client applications. Responses or acknowledgements are configured in Aggregation of Analysis agents connected to the REST Server agent. OAuth 2.0 protocol for authorization can optionally be deployed. If the REST API's schema is described in JSON or YAML files, the OpenAPI profile can be used to automatically generate UDR structures.

Reference:

  • RFC 2616 - Hypertext Transfer Protocol -- HTTP/1.1
  • RFC 6749 - OAuth 2.0 Authorization Framework
  • RFC 7617 - Basic HTTP Authentication Scheme

Radius


OnlineY9.0.0.0

Server
Receives accounting data (UDP packets) from one or multiple Network Access Servers (NASes). Supports IPv4 and IPv6 environments. Duplication check, Radius standard or CRC32, can be enabled.

Client
The Radius Client agent sends radius request to one or several Radius servers. Supports IPv4 and IPv6 environments. Transmissions errors can be configured to result in sending the requests on an alternate route.

Reference:

Real Time Disk CollectionOnlineY9.0.0.0

The legacy realtime disk collector. Is deprecated, and will be replaced with the Disk Collection Realtime Agent in the next major release.

Real Time Disk ForwardingOnlineY9.0.0.0

The legacy realtime disk forwarder. Is deprecated, and will be replaced with the Disk Forwarding Realtime Agent in the next major release.

SCP Collection



OnlineY9.0.0.0

Continuously scans and collects files from remote file system using the SCP protocol over SSH2.  Uses the Standard File Collection Functions and File Collection Functions Available for Realtime Only

For transaction safety reasons, the collection agent needs to be followed by an Analysis or Aggregation agent, as each file received needs to be acknowledged with a reply to the collection agent.

Based on the Batch SCP Collection Agent. Please refer to that package for more information.

SCP ForwardingOnlineY9.0.0.0

Forwards files to remote file system using the SCP protocol over SSH2. Uses the Standard File Forwarding Functions and File Forwarding Functions Available for Realtime Only

Based on the Batch SCP Forwarding Agent. Please refer to that package for more information.

SFTP Collection Realtime




OnlineY9.0.0.0

Continuously scans and collects files from remote file system using the SFTP protocol over SSH2.  Uses the Standard File Collection Functions and File Collection Functions Available for Realtime Only.

For transaction safety reasons, the collection agent needs to be followed by an Analysis or Aggregation agent, as each file received needs to be acknowledged with a reply to the collection agent.

Based on the Batch SFTP Collection Agent. Please refer to that package for more information.

SFTP Forwarding RealtimeOnlineY9.0.0.0

Forwards files to remote file system using the SFTP protocol over SSH2. Uses the Standard File Forwarding Functions and File Forwarding Functions Available for Realtime Only.

Based on the Batch SFTP Forwarding Agent. Please refer to that package for more information.

SMPP Receiver

Online

Y

9.0.0.0

Collects messages from SMSC (Short Message Service Center) and ESME (External Short Message Entity) using the SMPP (Short Message Peer to Peer) protocol. The configuration consists of connection details to the SMSC and ESME.

Reference:

SMPP Transmitter

Online

Y

9.0.0.0

Forwards messages to SMSC (Short Message Service Center) and ESME (External Short Message Entity) using the SMPP (Short Message Peer to Peer) protocol. The configuration consists of connection details to the SMSC and ESME.

Reference:

SQL Realtime Forwarding

Online

Y

9.0.0.0

Inserts UDR data into a database table according to configurable definitions of mapping between UDR fields and database table columns. Also, tables can be populated with MIM values using SQL statements or stored procedures. Commit frequency, queue sizes and exception handling is configurable.

SalesforceOnlineY9.0.0.0

A processing agent for real-time workflow configurations that subscribes to Salesforce topics and receive messages.

Streaming TelemetryOnlineY9.1.0.0

Streaming Telemetry retrieves router information (OSS data) using the gRPC protocol over HTTP/2. The agent supports gNMI (gRPC Network Management Interface) and JTI (Juniper Telemetry Interface). The implementations of GNMI and JTI are based on the content of the proto files. The proto files used:

gnmi.proto

gnmi_ext.proto

telemetry.proto

Syslog Collection

Online

Y

9.0.0.0

Supports IPv4 and IPv6. Compliant with the specifications RFC5424 and RFC3164 (used when RFC5424 is not applicable).

TCP/IP Collection

Online 

Y

9.0.0.0

Collects data via the standard TCP/IP protocol. Supports IPv4 and IPv6. Binds on a configurable port and allows multiple connections. Optionally, responses can be sent back (configured using the Analysis or Aggregation Agent). The agent has built-in support for decoding of data (configured using the Ultra Profile).

TCP/IP Forwarding

Online

Y

9.0.0.0

Forwards data via the standard TCP/IP protocol. Supports IPv4 and IPv6. Binds on a configurable port and allows multiple connections. Optionally, responses can be collected and processed by the workflow. All handling of responses is configured using Analysis or Aggregation agents.

Contains configurable parameters for optimizing performance. 

UDP Collection

Online

Y

9.0.0.0

Complies with the UDP protocol, RFC 768. Supports IPv4 and IPv6. Binds on a configurable port and allows multiple connections. Optionally, responses can be sent back (configured using the Analysis or Aggregation Agent). The agent has built-in support for decoding of data (configured using the Ultra Profile).

Web Services

Online

Y

9.0.0.0

Web Service agents communicate through SOAP in XML syntax, and use WSDL files.

Server/Collection
Receives request from one or several clients. Can operate synchronous (sends replies), or asynchronous (sends no replies).   

Client/Processing
Sends requests to one or several servers. Can operate synchronous (receives replies), or asynchronous (receives no replies).

Web Services agents support:

  • Web Service Interoperability Organization Basic Profile 1.1

  • WSDL 1.1

  • XML 1.0

  • SOAP 1.1

  • Partial support of Web Service Security 1.1

  • HTTP 1.1

  • HTTP Basic Access Authentication

  • Updatable Authorization header per request

  • HTTPS

  • IPv4 and IPv6

Websocket

Online

Y

9.0.0.0

Enables collection and forwarding of binary data and/or text frames from and to external web socket servers and clients. WebSocket is a protocol that enables bidirectional communication over a single TCP connection. 

References

  • WebSocket protocol, RFC 6455.


Limited Availability

Package

Type

Included in Subscription base license

Rel.

Description

5G SupportOnlineY9.0.0.0Enables 5G support (3GPP releases 15 and 16) for HTTP/2 Agents.

Azure Event Hub Agents

OnlineY9.0.0.0

Azure Event Hub consumer (collector) and producer (forwarding) agents. Authentication methods can be any of connection string, secret key or certificate. 

KPI Mangement

OnlineN9.0.0.0Enables in-memory generation of metrics for configurable groups of data. Supports creation of models for any number of hierarchies and metrics. The metrics are produced in configurable time intervals.
KPI Management DistributedOnlineN9.1.0.0Enables generation of metrics for configurable groups of data using Spark as back-end. Supports creation of models for any number of hierarchies and metrics. The metrics are produced in configurable time intervals.
KPI Management in MemoryOnlineY9.0.0.0Enables KPI generation using an in-memory processing agent.
LGU GTP

Online

N

9.1.0.0Customized non-standard version of GTP'. 
SAP CC Agent for NotificationOnlineN9.0.0.0Collection notifications from the SAP Convergent Charging Core Server via the SAP CC Notification Client.
SAP CC Batch Agent for ChargingOnlineN9.0.0.0Forwards batches to SAP CC batch charging interface. Supports versions 3, 4 and 5.
SAP CC Forwarding Agent for ChargingOnlineN9.0.0.0Forwards data to SAP CC charging interface. Supports versions 3, 4 and 5.
SAP JCo UploaderOnlineN9.0.0.0The SAP JCo Uploader agent is a batch fowarding agent, which sends records to SAP Convergent Invoicing (SAP CI) using the JCo protocol.
SAP RFC ProcessorOnlineN9.0.0.0

Real-Time Processing Agent used for communication between SAP systems, via the SAP RFC (Remote Function Call) interface.

The SAP RFC Processor agent supports SAP JCo Release 3.0.


File Collection Functions Available for Realtime Only

CategoryDescription
Decoder

The agent has built-in decoder, and thus no Decoder agent is needed in the workflow.

Decompression

Defines if files are compressed.

ExecutionDefines how often to scan for new input, how to handle formatting errors, and when to abort the workflow.


File Forwarding Functions Available for Realtime Only

CategoryDescription
File Closing CriteriaDefines if file closure shall be based on number of bytes, number of UDRs, or time.