Archiving Description
- Jenni Wallin
Usage Engine offers the possibility to archive data batches for a configurable period of time. The Archiving Agent is used to send all data batches it receives for archiving. Each data batch is saved as a file in a specified repository with a corresponding reference to the file in the database. Using the Archive Inspector, archived files can be browsed and deleted manually. Automatic deletion is handled via a predefined task that is executed regularly. The frequency of executing this clean up task, as well as the time period to keep the files, is configurable.
Archive Inspector
Depending on the selected profile, the Archive services are responsible for naming and storing each file and to purge outdated files at a regular basis. Utilizing the Directory Templates and base directories specified in the Archive Profile window, directory structures are dynamically built when files are stored. It is up to the administrator of the system to define which structure is suitable for each profile. Should the directory structure be changed on a daily basis, should it change based on collecting node name etc. The Archive services will automatically create all directories it needs below the base directories.
Each Archiving node can be configured to use a separate archive profile for its files, containing information about the target directory and removal of stored files. In the example below, a workflow is using Archiving Agents to store input and output.
Workflow with Archiving Agents
The example below shows:
- An Archive profile configuring the base directory, dynamic directory template and the time to keep files in archive.
An Archiving agent configuration where an archiving profile is selected, dynamic MiM values are mapped to the Directory Template structure and selected MiM values are logged in the Archive Inspector.
Archiving profile
Archive Inspection with its search functionality can be used to search for files for a specified period, in order to re-distribute the files to downstream system(s). Figure below is an example of the Archive inspector.
Archive Inspector