The GCP Storage forwarding agent creates files on the location stated in a referenced File System profile, containing the received data. Files are created when a Begin Batch message is received and closed when an End Batch message is received. In addition, the Filename Template service offers the possibility to compress (gzip) the files or to further process them, using commands.
To ensure that downstream systems will not use the files until they are closed, they are stored in a temporary directory until the End Batch message is received. This behaviour also applies to Cancel Batch messages. If a Cancel Batch is received, file creation is cancelled.
Example workflow with a GCP Storage Forwarding Agent
The section contains the following subsections:
Add Comment