You open the HTTP batch agent configuration dialog from a workflow configuration: you can right-click the agent icon and select Configuration..., or double-click the agent icon.
Connection
HTTP batch collection agent configuration dialog - Connection tab
| Field | Description | |||||
|---|---|---|---|---|---|---|
| URL | URL to the file that will be collected, the full URL to a file must be given.
| |||||
| Username | HTTP authorization username used in requests | |||||
| Password | HTTP authorization password used in requests |
Source
HTTP batch collection agent configuration dialog - Source tab
| Item | Description | |||||
|---|---|---|---|---|---|---|
| Compression | Select if the agent should try to decompress the data collected before routing it into the workflow. The options are 'No Compression' and 'Gzip'.
| |||||
Enable Index Based Collection | Select to Enable Index Based Collection. All linked-to URLs found in the HTML-formatted document will be collected. The URL is pointed out in the URL field in the section above, Connection. | |||||
URL Pattern | Either leave empty or enter a regular expression filtering the full URL. If empty all files are collected, otherwise files matching the URL Pattern will be collected. The URL itself will not be routed into the workflow. | |||||
Enable Control File Based Collection | When selected, the agent will only collect files with a control file present. The appearance of the control file is made by defining Position and the appearance of the expected control file. | |||||
Position | The control filename consists of an extension added either before or after the shared filename part. There are two choices: Prefix or Suffix refer to the example below, Control File Extensions, for more information. | |||||
Control File Extension | The Control File Extension is used to define when the data file should be collected. A data file will only be collected if the corresponding control file exists. The text entered in this field is the expected extension to the shared filename. The Control File Extension will be attached to the shared filename depending on the setting made in the Position field, refer to the example below, Control File Extensions, for more information. | |||||
Data File Extension | The Data File Extension is an optional field that is used when a stricter definition of files to be collected is needed. It is only applicable if the Position is set to Suffix. Refer to the example below for more information.
| |||||
Enable HTTP DELETE | Selecting this will issue the web server to delete the file and the control file after the file has been successfully collected. If unchecked the file will be ignored after collection, that is the file will be left in on the webserver. |
Advanced
HTTP batch collection agent configuration dialog - Advanced tab
| Item | Description |
|---|---|
| Keystore | Name of the keystore file that has been imported and will be used by the agent. Select and select the file to be used by the agent. |
| Keystore Password | Password to be used on the selected keystore file. |
| Read Timeout (ms) | The maximum time, in milliseconds, to wait for response from the server. 0 (zero) means to wait forever |
Duplicate Check
HTTP batch collection agent configuration dialog - Duplicate Check tab
...