Disk Collection Agent Configuration - Batch
You open the Disk collection agent configuration dialog from a workflow configuration. To open the Disk collection agent configuration, click  Build → New Configuration. Select  Workflow from the Configurations dialog. When prompted to Select workflow type, select Batch. Click Add agent and select Disk from the Collection tab of the Agent Selection dialog.
Part of the configuration may be done in the Filename Sequence or Sort Order service tab described in Workflow Template.
Disk Tab
The Disk tab contains settings related to the placement and handling of the source files to be collected by the agent.
Disk collection agent configuration - Disk tab
Setting | Description |
---|---|
Collection Strategy | If there is more than one collection strategy available in the system a Collection Strategy drop-down list will also be visible. For more information about the nature of the collection strategy, refer to Appendix 4 - Collection Strategies. |
Directory | Enter the absolute pathname of the source directory on the local file system, where the source files reside. The pathname might also be given relative to the Note! Even if a relative path is defined, for example, |
Include Subfolders | Select this check box if you have subfolders in the source directory from which you want files to be collected. Note! Subfolders that are in the form of a link are not supported. If you select Enable Sort Order in the Sort Order tab, the sort order selected will also apply to subfolders. |
Filename | Enter the name of the source files on the local file system. Regular expressions according to Java syntax applies. For further information, see http://docs.oracle.com/javase/8/docs/api/java/util/regex/Pattern.html. Example To match all filenames beginning with |
Compression | Select the compression type of the source files. Determines if the agent will decompress the files before passing them on in the workflow.
|
Move to Temporary Directory | If enabled, the source files will be moved to the automatically created subdirectory |
Append Suffix to Filename | Enter the suffix that you want added to the file name prior to collecting it. Important! Â Before you execute your workflow, make sure that none of the file names in the collection directory include this suffix. |
Inactive Source Warning (hours) | If the specified value is greater than zero, and if no file has been collected during the specified number of hours, the following message is logged: The source has been idle for more than <n> hours, the last inserted file is <file>. |
If enabled, the source files will be moved from the source directory (or from the directory If the Prefix or Suffix fields are set, the file will be renamed as well. Note! It is possible to move collected files from one file system to another however it causes negative impact on the performance. Also, the workflow will not be transaction safe, because of the nature of the If it is desired to move files between file systems it is strongly recommended to route the Disk collection agent directly to a Disk forwarding agent, configuring the output agent to store the files in the desired directory. Refer to Disk Forwarding Agent - Batch for information. This is because of the following reasons:
| |
If enabled, the source files will be renamed after the collection, remaining in the source directory from which they were collected (or moved back from the directory | |
If enabled, the source files will be removed from the source directory (or from the directory DR_TMP_DIR, if using ), after the collection. | |
If enabled, the source files will remain in the source directory after collection. | |
Destination | Enter the absolute pathname of the directory on the local file system of the EC into which the source files will be moved after collection. The pathname might also be given relative to the $MZ_HOME environment variable. This field is only enabled if Move to is selected. |
Prefix/Suffix | Enter the prefix and/or suffix that will be appended to the beginning respectively the end of the name of the source files, after the collection. These fields are only enabled if Move to or Rename is selected. Note! If Rename is enabled, the source files will be renamed in the current directory (source or |
Search and Replace | To apply Search and Replace, select either Move to or Rename.
Search and Replace  operate on your entries in a way that is similar to the Unix sed utility. The identified filenames are modified and forwarded to the following agent in the workflow. This functionality enables you to perform advanced filename modifications, as well:
Search and Replace Examples To rename the fileÂ
To rename the fileÂ
Note! The search value divides the file name into two parts with brackets. The replace value applies the second part with the place holder $2. |
Keep (days) | Enter the number of days to keep source files after the collection. In order to delete the source files, the workflow has to be executed (scheduled or manually) again, after the configured number of days. Note, a date tag is added to the filename, determining when the file may be removed. This field is only enabled if Move to or Rename is selected. |
Use File Reference | Select this check box if you want to forward the data to an SQL Loader agent. See SQL Loader Agent for further information. |