Quarterly Release Update for Usage Engine Cloud Edition - April 2025
Originally published: April 17th 2025
During the last quarter, we have released one major feature and seven enhancements:
- 1 New Features
- 2 Enhancements
- 2.1 Move to option for Amazon S3 and Azure Blob Storage collectors
- 2.2 Upgraded general user interface
- 2.3 Resuming the running of stream in stream groups
- 2.4 Expanded validation support for Array and Object
- 2.5 Customizable target field to rename output field names
- 2.6 New 15 and 30-minute aggregation intervals are available
- 2.7 Script errors in user logs now include line numbers
New Features
Introducing the Snowflake Collector function
Snowflake Collector is a new addition to Usage Engine Cloud Edition’s integrated function library, designed for ease of configuration and execution. You can configure this function with authentication and credentials to read data from a Snowflake database, enabling you to write SQL statements for retrieving specific or comprehensive datasets using the SQL editor, see https://infozone.atlassian.net/wiki/spaces/DAZ/pages/864911550.
Enhancements
Move to option for Amazon S3 and Azure Blob Storage collectors
The Move to option is now available for Amazon S3 and Azure Blob Storage collectors. This update helps you manage and process source files by reducing manual steps and simplifying file management. After collection, files can be moved to a different directory for organization or reprocessing.
This feature was initially released for SFTP and Google Cloud Storage collectors in December 2024, see https://infozone.atlassian.net/wiki/spaces/DAZ/blog/2025/01/20/453443589/Quarterly+Release+Update+for+Usage+Engine+Cloud+Edition+-+January+2025#Move-to-option-for-collectors.
Upgraded general user interface
The general user interface of Usage Engine Cloud Edition has been upgraded with the latest user interface components allowing for smoother micro-animations, efficient use of white spaces, overall improved consistency and responsiveness. Apart from giving the interface a cleaner look and feel, the interface now also performs smoother, along with fixed discrete visual glitches.
Resuming the running of stream in stream groups
Previously, stream groups had to be recreated and rerun from the first stream whenever a stream within the group failed or stopped. This reduced the efficiency of stream groups which were intended to reduce time when running a collection of streams consistently and frequently. Now, instead of having to recreate the stream group and rerun all the streams, you can now use the Resume option to start running the stream group from the first failed or stopped stream.
Expanded validation support for Array and Object
The Validate function now supports validation rules for array and object fields. This allows you to easily create more advanced validation rules on arrays or objects, see https://infozone.atlassian.net/wiki/x/MwcKGg.
Customizable target field to rename output field names
The Data aggregator now lets you rename the field used to store aggregated values. This is especially useful when sending data to an external system that requires specific field names.
Previously, you had to use the Field organizer function to rename the output field, but this can now be done directly in the Data aggregator configuration. The field—called the Target field—is automatically named based on the source field and the aggregation operation (for example, sum_view_duration for a SUM of view_duration), see https://infozone.atlassian.net/wiki/spaces/DAZ/pages/866353176.
New 15 and 30-minute aggregation intervals are available
You can now group aggregation sessions by 15 or 30-minute intervals based on any date or time field in the input record, see https://infozone.atlassian.net/wiki/spaces/DAZ/pages/866353176.
Script errors in user logs now include line numbers
The error handling for Script functions has been enhanced by including line numbers in user logs that show where the script execution has failed. This makes it easier to identify the exact point of failure, helping you troubleshoot and debug more efficiently.
We hope you enjoy these new enhancements. As always, we appreciate your feedback. If you have any questions or concerns, please do not hesitate to reach out to us through our Self Service Portal.