To open the real-time Disk (Deprecated) collection agent configuration, click Build → New Configuration. Select Workflow from the Configurations dialog. When prompted to Select workflow type, select Realtime. Click Add agent and select Disk Deprecated from the Agent Selection dialog. Double-click the agent icon or right-click the icon and select Edit agent, to display the Agent Configuration dialog.
Disk_Deprecated Tab
The Disk_Deprecated tab contains settings related to the placement and handling of the source files to be collected by the agent.
Disk (Deprecated) collection agent - Disk_Deprecated tab
File Information
| Setting | Description | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Directory | Enter the path of the source directory on the local file system of the EC, where the source files reside. The path can be absolute or relative to the During processing of a file, it will be temporarily stored in a subdirectory under | ||||||||||
| Filename | Enter an expression that matches the source files on the local file system. Regular expressions according to Java syntax applies. For further information, see: http://docs.oracle.com/javase/8/docs/api/java/util/regex/Pattern.html
| ||||||||||
| Compression | Select Gzip to decompress files before collection and insertion into the workflow. If the collected files are not compressed, select No Compression. | ||||||||||
| Polling Interval (ms) | Enter the interval, in milliseconds, at which the source directory is to be scanned for new files. | ||||||||||
| File Reader Size | The agent moves files to the temporary directory for processing in bulk. Enter the maximum number of files to be included in each bulk move operation. | ||||||||||
| Read Size (b) | Enter the buffer size to be used for for reading files. When a decoder is selected the agent produces
| ||||||||||
No of Thread(s) | Enter the number of worker threads that should be used for file collection. This field determines the number of files that the agent can process concurrently. You should typically set the number of threads to match the number of workflow threads. To ensure that the files are processed in timestamp order, set No of Thread(s) to 1 and also select the checkbox Sort Files. | ||||||||||
| Sort Files | Select this checkbox to sort the files that are moved to the temporary directory for processing. The files are sorted according to timestamp in ascending order. Due to multithreading, the files may not be processed in this order. | ||||||||||
| Timeout Handling | |||||||||||
| Timeout (ms) | When the agent routes the first partial data set to the workflow, a timeout counter starts. The timeout counter is reset when the workflows acknowledge reception of the complete file. If the timeout counter is exceeded the collected file is either moved to a user-specified directory or After Collection strategy is applied. Enter the timeout value in milliseconds. | ||||||||||
| Move Files on Timeout | Select this checkbox to move timed out files to an automatically created subdirectory that you specify in the Directory setting.
| ||||||||||
| Path | When Move Files on Timeout is selected, enter the target directory for files that are subject to timeout handling. | ||||||||||
| After Collection | |||||||||||
| Move/Rename | Select this radio button to move the source files to the directory specified in the Destination field, after the collection. If you use the Prefix or Suffix fields, the file is renamed as well. Enter the path of the directory on the local file system of the EC into which the source files should be moved after collection. The path can be absolute or relative to the
| ||||||||||
| Prefix/Suffix | Enter the prefix and/or suffix to append to the beginning/end of the name of the source files, after the collection. These fields are available if you have selected Move or Rename.
| ||||||||||
| Search/Replace |
Search: Enter the part of the filename that you want to replace. Replace: Enter the replacement text. Search and Replace operate on entries in a way that is similar to the Unix The identified filenames are modified and forwarded to subsequent agents in the workflow. This functionality enables you to perform advanced filename modifications as well:
| ||||||||||
| Remove | If this radio button is selected, the source files are removed from the source directory after collection. | ||||||||||
Decoder Tab
The Decoder tab contains settings related to decoding of the collected data.
Disk_Deprecated collection agent - Decoder tab
...