Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Update image. Done

...

Today, to be highly competitive, businesses need to be really efficient and quick in decision making. In order to do this, they need to process the vast amount of data crucial data crucial for making the right decisions at the right time. It is important to collect a high-quality and large amount amounts of accurate data to create relevant results and this is where data aggregation comes into the picture. Data aggregation is a the process of collecting and summarizing data for statistical analysis.

In this example, we build a simple stream that summarizes the number of games downloaded by a user for each month and writes it in a log. Image Removed

...

Functions used in this stream and their purpose:

...

  • Counter that triggers the stream to run

...

  • as many times as specified in the configuration.

  • Simulate Data (Script) - Simulates

...

  • data with a daily record of a number of games downloaded by a user.

...

  •  This step substitutes real data input.

  • Data Aggregator - Summarizes the monthly

...

  • number of games downloaded.

  • Monthly Record (Field Organizer) - Filters the required data for business processing.

  • Log - Writes the received summary event in a log.

...

  •  This step substitutes data

...

  • being sent for billing.