File selection

All files in folder

Select this option to collect all files in the specified folder.

Based on filename

Select this option to collect files based on specific file names. You can specify one or several file names.

Based on regular expression

Select this option to collect files based on file name patterns that you state using regular expressions.

Based on list of files

Select this option to collect files using a meta file containing the path to another file. If there is more than one meta file present, they will be processed simultaneously.

You need to specify the following for the meta file:

Image Removed

Image Added

There are also three mandatory prerequisites for this option:

• If there are more than one meta file, all of them need to be stored in the same folder.

• The meta files must be in CSV format with a single header.

• If this type of collection is no longer used, the meta file must be removed manuall

File format

Depending on what option you select in the this drop-down, you will see different complimentary settings beneath the drop-down list.

CSV

Select this option to collect files in CSV format. Select the Include table header check box to include the table header in the collected file(s).

Select the delimiter for the CSV file(s) in the Delimiter field. Comma is selected by default but you can also select Tab, Semicolon, Space, or Other. If you select Other you can specify a custom delimiter in the Custom delimiter field that will then be displayed.

Excel

Select this option to collect files in Excel format. Select the Include table header check box to include the table header in the collected file(s).

Select the All sheets in file option to collect everything in the file, or the Specific Sheet(s) option to specify which sheets you want to collect in the Select sheet(s) field that will be displayed.

JSON

Select this option to collect files in XML format.

XML

Select this option to collect files in XML format

Collector filename

Select

this option if you want to keep the same filename as

the input file(s).

The function appends the file format extension to the filename based on the file format selected in Step 5, if the selected extension is not in the filename.

Custom filename

Select

this option to define a new filename for

the output files.

See Configuring Dynamic Naming in Fields

for information on how to define filenames with additional flexibility.

The function appends the file format extension to the filename based on the file format selected in Step 5, so you do not need to add any extensions to the filename.

CSV

Select this option to send the

files in CSV format.

Select the Include table header

check box to include the table

header in the output file(s).

Select the delimiter for the CSV file

(s) in the Delimiter field. Comma is selected by default but you can also select Tab, Semicolon, Space, or Other. If you select Other you can specify a custom delimiter in the Custom delimiter field that will then be displayed.

You can select to compress the files by selecting the Compress file option. A drop-down list will then be displayed in which you can select either Zip or GZip.

Select the Bucket owner full control option to enable full control over any new objects that are written by other AWS accounts.

Excel

Select this option to send the output file in Excel format. You can

then select to specify the name of the sheet in the Sheet name field that is displayed. The default

name is

“Sheet 1”.

You can select to compress the files by selecting the Compress file option. A

drop-down list will then be displayed in which you can select either Zip or GZip.

Select the Bucket owner full control

option to enable full control over any new objects that are written by other AWS accounts.

Buffer

Select this option to send the output file in

Buffer format

, which is useful if you are reading or processing files containing binary data

for

performance

reasons,

for example.

You can select to compress the files by selecting the Compress file option. A

drop-down list will then be displayed in which you can select either Zip or GZip.

Select the Bucket owner full control

option to enable full control over any new objects that are written by other AWS accounts.

JSON

Select this option to send the output file in the JSON format.

You can then select the output format you want to use in the Action on record: drop-down list;

• one file with All in one array

• one file with All in one array with key

• or One file per record.

You can select to compress the files by selecting the Compress file option. A

drop-down list will then be displayed in which you can select either Zip or GZip.

Select the Bucket owner full control option to enable full control over any new objects that are written by other AWS accounts.

You can also select the Output file in pretty print option

to format the JSON files for easier reading.

fileName

Name of the file.

Syntax

log.info(meta.fileName);

filePath

Path from where the file is collected. The file can be either in the Excel or CSV format.

Path format: bucket/folder/file

Syntax

log.info(meta.filePath);

fileSize

Size (in bytes) of the file.

Syntax

log.info(meta.fileSize); 

sheetName

Name of the sheet of the Excel file.

Syntax

log.info(meta.sheetName);

collectionTime

Timestamp when the file is collected.

Syntax

log.info(meta.collectionTime);