The GCP Storage forwarding agent creates files on the location stated in a referenced File System profile, containing the received data. Files are created when a Begin Batch message is received , and closed when an End Batch message is received. In addition, the the Filename Template service service offers the possibility to compress (gzip) the files , or to further process them, using commands.
To ensure that downstream systems will not use the files until they are closed, they are stored in a temporary directory until the End Batch message is received. This behavior behaviour also applies to Cancel Batch messages. If a Cancel Batch is received, file creation is cancelled.
Example workflow with a GCP Storage Forwarding Agent
Scroll ignore | ||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||||||
The section contains the following subsections: |
...