05. System Extensions PE 4
- Sandra Dusic
General Availability
Name | Type | Included in Subscription base license | Release | Description |
|---|---|---|---|---|
APL Collection Strategies | System | Y | 4.2.0 | An addition (a tab in the UI) to the Disk, FTP, SFTP, and SCP collection agents. Enables APL code to be used to define complex collection rules. Includes function blocks for detailed filtering and processing for:
|
APL Extensions | Both | Y | 4.2.0 | Add-ons to the APL library of functions. Contains:
|
Amazon Redshift | System | Y | 4.2.0 | Addition to the Database Profile;Â DB connectivity package (JDBC) for Amazon Redshift. Usage:
|
Amazon S3 External Reference | System | Y | 4.2.0 | Enables storage of External Reference files in Amazon S3 buckets. |
Authorization Server | System | Y | 4.2.0 | The Authorization Server is an optional feature used for generating access tokens for accessing REST APIs hosted by the HTTP/2 Server agent. Client applications that wish to connect must be registered first using the Authorization Server's Management API. |
Azure Application Insight Event Notifier | System | Y | 4.2.0 | Event Notification support for Azure Application Insight. |
Azure KeyVault | System | Y | 4.2.0 | Enables configuration of access credentials and properties to be used to connect to an Azure KeyVault. |
Azure OAuth2 APL plugin | System | Y | 4.2.0 | APL plugin for acquiring an OAuth2-token from Azure servers. |
CSV | System | Y | 4.2.0 | DB connectivity package (JDBC) for CSV files that makes it possible to read CSV files instead of databases when:
|
Cassandra | System | Y | 4.2.0 | Addition to the Database Profile;Â DB connectivity package (JDBC) for Cassandra. Usage:
|
Categorized Grouping | Offline | Y | 4.2.0 | A processing agent that divides incoming data into categories - each resulting in separate forwarding files. A category can contain data from one or several files. Closure criteria for the categories is configurable. |
Collection Strategy - Control Files | Offline | Y | 4.2.0 | An addition (a tab in the UI) to the Disk, FTP, SFTP, and SCP collection agents. Enables collection of files for which a corresponding control file exist. |
Collection Strategy – Duplicate Filter | Offline | Y | 4.2.0 | An addition (a tab in the UI) to the Disk, FTP, SFTP, and SCP collection agents. Enables duplication check for all collect files from a directory against a configurable number of files to keep as reference. Verification criteria can be based on filename and optionally time stamp. |
Collection Strategy – Multi Directory | Offline | Y | 4.2.0 | An addition (a tab in the UI) to the Disk, FTP, SFTP, and SCP collection agents. Enables collection of files from a series of directories listed in a control file. |
Compression agent | Offline | Y | 4.2.0 | Processing agents that compresses data (GZIP format). |
Conditional Trace | Realtime | Y | 4.2.0 | Conditional Trace has been rewritten to track all changes to selected UDRs in a workflow, and be plug-and-playable to Jaeger, a state-of-the-art trace logging system. This provides for complete trace logs and a rich set of filtering and troubleshooting tools. |
Couchbase for Aggregation | Online | Y | 4.2.0 | Aggregation storage based on Couchbase. Couchbase enterprise edition license (commercial support) is required. |
Data Hub | Offline | Y | 4.2.0 | Data Hub provides the ability to store and query large amounts of data processed by the system. Typical usage of Data Hub includes:
Data Hub requires access to Cloudera Impala, data stored in an Hadoop filesystem (HDFS). |
Data Masking | Both | Y | 4.2.0 | A Profile and Processing agent, that either masks or unmasks specified fields in selected UDRs. Available masking methods:
|
Data Masking Hash/Database Storage | System | N | 4.2.0 | Support for Data Masking Hash/Database Storage. |
Data Veracity | System | Y | 4.2.0 | An alternative to the Error Correction System available out-of-the-box in the platform. Stores data failing validation in an external database, and is better suited for high load operations.Â
|
Database APL Functions | Both | Y | 4.2.0 | Add-ons to the APL library of functions. Contains:
|
Decompression Agent | Offline | Y | 4.2.0 | Processing agents that decompresses data (GZIP format). |
Distributed Storage Couchbase | Online | Y | 4.2.0 | Enables access to a Couchbase distributed storage solution from APL without having to provide details about its type or implementation. This makes APL code generic and independent of storage solutions changes, which are handled in the Profile. APL functions available for data management:
|
Distributed Storage Redis | Online | Y | 4.2.0 | Enables access to a Couchbase distributed storage solution from APL without having to provide details about its type or implementation. This makes APL code generic and independent of storage solutions changes, which are handled in the Profile. APL functions available for data management:
|
Elasticsearch Aggregation Storage | Offline | Y | 4.2.0 | A Profile enabling Elasticsearch to be used as Aggregation storage. |
Free format SQL loader agent | Offline | Y | 4.2.0 | Processing agent that populates a database with data from files, using a configurable SQL statement. |
Google Secret Manager | System | Y | 4.2.0 | Â |
HTTP Client APL Functions | System | Y | 4.2.0 | APL plug-in for HTTP requests handling. |
IBM DB2 | System | Y | 4.2.0 | Addition to the Database Profile;Â DB connectivity package (JDBC) for IBM DB2. Usage:
|
IBM Netezza | System | Y | 4.2.0 | Addition to the Database Profile;Â DB connectivity package (JDBC) for IBM Netezza. Usage:
|
JSON Interface | System | Y | 4.2.0 | Enables JSON decoding and encoding. Reference:
|
JWT APL Functions | Online | Y | 4.2.0 | Support for JSON Web Tokens (JWT) signature verification. |
Kafka Agents (Legacy version) | Online | Y | 4.2.0 | Â |
LDAP | Both | Y | 4.2.0 | APL functions for connecting (using anonymous or simple authentication) to an external LDAP directory and performing search, add, delete, and modify operations. In SDR: APL plug-in for LDAP look-up from workflow |
LDAP Authentication | System | Y | 4.2.0 | Enables LDAP as authentication method in the Access Controller UI. The authentication and administration is delegated to an external LDAP directory. |
LZO Support | System | Y | 4.2.0 | Adds LZO decompression support to a collection agent's configuration UI. Any flags to the standard unix command "lzop" can be added. Reference: |
MS SQL Server | System | Y | 4.2.0 | Addition to the Database Profile;Â DB connectivity package (JDBC) for SQL Server. Usage:
|
MariaDB | System | Y | 4.2.0 | Addition to the Database Profile;Â DB connectivity package (JDBC) for MariaDB. Usage:
|
Merge File Collection | Offline | Y | 4.2.0 | Collects and merges files based on number of files or bytes. A collected batch will consist of all files matching the search criteria for a particular workflow activation. |
MySQL | System | Y | 4.2.0 | Addition to the Database Profile;Â DB connectivity package (JDBC) for MySQL. Usage:
|
PKCS7 | System | Y | 4.2.0 | APL functions supporting signing of data using CMS signature.
|
PostgreSQL | System | Y | 4.2.0 | Addition to the Database Profile;Â DB connectivity package (JDBC) for PostgreSQL. Usage:
|
Python Task | Offline | Y | 4.2.0 | Allows for Python executable to be scheduled and run from a Task Workflow. User defined Interpreter can be used by configuration in the Python Profile. |
Realtime Ordered Routing | Online | N | 4.2.0 | Queue Strategy that maintains the order of UDRs as provided by the source. |
Redis for Aggregation | Online | Y | 4.2.0 | Aggregation storage based on Redis. For commercial support RedisLabs license is required. |
Reference Data Management | System | Y | 4.2.0 | Delivers the capability to query and edit specific table sets in relational databases while schema permissions remain unaltered. |
SAP Hana | System | Y | 4.2.0 | Addition to the Database Profile;Â DB connectivity package (JDBC) for Snowflake. Usage for SAP Hana v1 and v2:
In addition to the functions listed above, the SAP HANA database 2.0 can be used with the following functionality:
|
SCIM | System | Y | 4.2.0 | A REST HTTP interface enabling SCIM management of users and groups. Supports POST, GET, DELETE, PUT and PATCH methods for user and group configurations.  References: |
SNMP Request | Online | Y | 4.2.0 | Polls management and operational status data from SNMP-enabled network elements. The list of network elements to poll from is provided as a CSV file in the agent's configuration. The SNMP Collection profile is used to import the set of MIBÂ files that will be used to build the target UDRs, as well as configure default parameters for connection. The SNMP OID Profile defines which UDR types and fields to poll. |
SNMP Trap | Online | Y | 4.2.0 | Receives SNMP notifications, i e traps and informs. The SNMP Collection profile is used to import the set of MIBÂ files that will be used to build the target UDRs, as well as configure default parameters for connection. |
SQL Collection | Offline | Y | 4.2.0 | Free format SQL collection agent: Collects rows from databases and inserts them as UDRs into a workflow. A configurable SQL query is executed upon workflow activation, and all matching rows will comprise a batch of UDRs. The format of the UDRs is configurable. Several databases are supported, Â please refer to the System Extensions section. |
SQL Forwarding | Offline | Y | 4.2.0 | Free format SQL forwarding agent: Inserts UDRs as rows in database tables. Table columns can be populated with UDR fields or MIM values. Optionally, commit window size can be set. Configurable exception handling allows for alternate routes for failed inserts. Several databases are supported, Â please refer to the System Extensions section. |
SQL for Aggregation | Offline | Y | 4.2.0 | Aggregation storage based on SQL relational database: Allows batch aggregation to be done using databases instead of using persistent geo-redundant disk storage. |
SSO | System | Y | 4.2.0 | Enables Single Sign On with external OpenID Provider, along with multi factor authentication. |
Shared Memory Table | Both | Y | 4.2.0 | Enables workflows to share in-memory tables for lookups. This table lookup service is defined in a Shared Table Profile. |
Snowflake | System | Y | 4.2.0 | Addition to the Database Profile;Â DB connectivity package (JDBC) for Snowflake. Usage:
|
Sybase IQ | System | Y | 4.2.0 | Addition to the Database Profile;Â DB connectivity package (JDBC) for Sybase IQ. Usage:
|
Teradata | System | Y | 4.2.0 | Addition to the Database Profile;Â DB connectivity package (JDBC) for Teradata. Usage:
|
TimesTen | System | Y | 4.2.0 | Addition to the Database Profile;Â DB connectivity package (JDBC) for TimesTen. Usage:
|
Ultra GPB support (Google Protocol Buffer) | System | Y | 4.2.0 | Enables GPB definition support in UFDL, allowing GPB data to be Decoded and Encoded. Both the proto2 and proto3 versions of the GPB language are supported. |
Ultra XML | System | Y | 4.2.0 | Enables XML schema support in UFDL, allowing XML data to be Decoded and Encoded. |
Unit Test | System | Y | 4.2.0 | Enables test of workflows and APL Profiles. Tests are configured using Python programming, and can be exported and imported the same way as any other configuration. |
Vertica | System | Y | 4.2.0 | Addition to the Database Profile;Â DB connectivity package (JDBC) for Vertica. Usage:
|
Web API | System | Y | 4.2.0 | HTTP-based API enabling external systems to collect status information from selected parts of the system, including stop and start workflows and groups. |
Workflow bridge Batch -> Realtime | Both | Y | 4.2.0 | Forwarding and Collection Agents for sending data from a batch workflow to a realtime workflow. The data is stored in memory cache if the workflows are executing on the same JVM, or is transferred using TCP or Aeron in case the workflows reside on different JVMs. |
Workflow bridge Realtime-> Realtime | Online | Y | 4.2.0 | Forwarding and Collection Agents for sending data from a realtime workflow to a realtime workflow. The data is stored in memory cache if the workflows are executing on the same JVM, or is transferred using TCP or Aeron in case the workflows reside on different JVMs. |
Workflow Packages | System | Y | 4.2.0 | Configuration can be bundled into workflow packages and exported to other systems. Advantages compared to regular export format:
|
Limited Availability
Name | Type | Included in Subscription base license | Rel. | Description |
|---|---|---|---|---|
Avro Support | System | Y | 4.2.0 | Consists of two parts (two different ways of using Avro data):
|
Kafka Agents | Both | Y | 4.2.0 | Â |
System Landscape Directory | System | N | 4.2.0 | Command to extract system topology in SAP SLD format. |
TMO Collection | Offline | N | 4.2.0 | Customer specific package. |