Today, to be highly competitive, businesses need to be really efficient and quick in decision making. In order to do this, they need to process the vast amount of data crucial data crucial for making the right decisions at the right time. It is important to collect a high-quality and large amount amounts of accurate data to create relevant results and this is where data aggregation comes into the picture. Data aggregation is a the process of collecting and summarizing data for statistical analysis.
In this example, we build a simple stream that summarizes the number of games downloaded by a user for each month and writes it in a log.
Functions used in this stream and their purpose:
Count - Counter Counter that triggers the stream to run for as many times as specified in the configuration.
Simulate Data (Script) - Simulates data with a data with a daily record of a number of games downloaded by a user. This This step substitutes real data input.
Data Aggregator - Summarizes the monthly number of number of games downloaded.
Monthly Record (Field Organizer) - Filters the required data for business processing.
Log - Writes the received summary event in a log. This This step substitutes data being sent being sent for billing.