During the last quarter, we have released the following new features and enhancements:

With the Date function, you can add, modify, and transform date-time values in your data. It can be used for reformatting dates, for example, converting YYYY/MM to YYYY-MM-DDTHH:mm:ss, creating new date fields, copying and editing existing date fields, or adjusting dates by adding or subtracting time units, such as days, hours, or minutes. This function is designed to make date-handling in your streams more flexible and consistent. See https://infozone.atlassian.net/wiki/x/cAB6Hw.

Open

One of the main challenges in developing a stream is maintaining any form of documentation on its purpose. Streams can have varying complexities, and can be built through a shared custody with a team rather than a single developer. Therefore, a stream’s complexity may require thorough context and descriptions for every moving part in the stream that has to be communicated with every custodian, whether it is to maintain or troubleshoot the stream, or to make enhancements or upgrades for better operations.

Open

With the new Annotation features, you can add annotations directly to a stream. You can enter a high-level description, outlining the stream’s purpose and logic and other relevant details in a text box on the canvas. You can also add annotations to function groups, which are collections of related functions within the stream. This allows you to provide context, logical grouping, or usage notes specific to those grouped functions, improving clarity around complex operations. The annotations can be color coded for better readability.

Open

By providing context directly within the stream editor, annotations significantly enhance collaborative stream development by embedding clear, and contextual documentation , at both the stream and function group levels, that can be exported and imported between streams. See https://infozone.atlassian.net/wiki/spaces/DAZ/pages/547783052.

The NDJSON (Newline Delimited JSON) file format is now supported in file forwarders, in addition to the standard JSON file format that has been available by default. NDJSON enables efficient forwarding of structured data to cloud storage, making it easier to manage and process large datasets. This enhancement is available within the https://infozone.atlassian.net/wiki/spaces/DAZ/pages/848625703 , Google Cloud Storage, Azure Blob Storage, and SFTP forwarders, providing greater flexibility and improved data handling for your workflows.

In Usage metering, you can now add custom fields, like customer ID or address, when you create or update a meter using the API. These custom fields are stored with each meter and included in the final output. You can add, update, or remove custom fields at any time through the API. When the meter data is processed, the custom fields are part of the metered output and can be sent directly to other systems. This enables direct integration with downstream systems, such as billing, without needing additional enrichment steps. See https://infozone.atlassian.net/wiki/x/qwJoDQ.

The Validate function now includes an optional additional output, making it easier to manage invalid records in streams. With this enhancement, you can send invalid records to another function in the stream, forward them to Data Correction, or do both. The option to discard invalid records is still available, as before. These new choices provide greater flexibility for handling data quality issues within streams. See https://infozone.atlassian.net/wiki/x/edZ3.

Open

We hope you enjoy these new enhancements. As always, we appreciate your feedback. If you have any questions or concerns, please do not hesitate to reach out to us through our Self Service Portal.