HTTP Batch Agent

This section describes the HTTP batch agent. The HTTP batch collection agent collects from either a single URL or, in Index Based Collection mode, it collects all linked-to URLs found in an HTML-formatted document (Anchor HREF attributes).

The agent will download the files from the web server as a byte stream and route the content of the file into the workflow in parts of up to 32768 bytes.

The system supports both HTTP and HTTPS. The filename of the file to be collected must be known before collection.

Prerequisites

The reader of this information should be familiar with:

  • HTTP/HTTPS protocol

  • UDR structure and contents