9.2.3 ADLS2 File Forwarding Agent
The ADLS2 file forwarding agent creates files on the Azure Data Lake Storage using the access credentials in an Azure profile, containing the received data. Files are created when a Begin Batch message is received, and closed when an End Batch message is received. In addition, theĀ Filename TemplateĀ service offers the possibility to compress (gzip) the files, or to further process them, using commands.
To ensure that downstream systems will not use the files until they are closed, they are stored in a temporary directory until the End Batch message is received. This behavior also applies to Cancel Batch messages. If a Cancel Batch is received, file creation is cancelled.
The section contains the following subsections:
- 9.2.3.1 ADLS2 File Forwarding Agent Configuration
- 9.2.3.2 ADLS2 File Forwarding MultiForwardingUDR Input
- 9.2.3.3 ADLS2 File Forwarding Agent Transaction Behavior
- 9.2.3.4 ADLS2 File Forwarding Agent Input/Output Data and MIM
- 9.2.3.5 ADLS2 File Forwarding Agent Events