Amazon S3 collector input/output data

Amazon S3 collector input/output data

576a2e8d-1dc6-4166-88ce-fe1eebec9f82.png

This page provides examples of input and output data in your stream’s Amazon S3 collector. For a detailed tutorial that uses the Amazon S3 collector function, see the configuration steps at Stream using Amazon S3 collector and forwarder.

Note!

The input/output data shown on this page is taken from the documentation linked above.

Input data

The input data for the Amazon S3 collector function comes from the files stored in the specified Amazon S3 bucket and folder path that you configure during setup.

The data flows from the source S3 bucket (collected by the Amazon S3 collector), through any processing or aggregation steps in the Data aggregator function, and is then forwarded and stored in a destination S3 bucket by the Amazon S3 forwarder function.

amazons3-tutorial-full.png
Input data from the Amazon S3 collector

Output data

The output data after collection, the output consists of the records from that file, structured according to the file format and options you configured.

as3t-preview-collection.png
Output data from the Amazon S3 collector